Sep 24 18:00:29 devstack cinder-volume[76404]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=76404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 24 18:00:29 devstack cinder-volume[76404]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=76404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 24 18:00:29 devstack cinder-volume[76404]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=76404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 24 18:00:31 devstack cinder-volume[76404]: INFO dbcounter [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Registered counter for database cinder
Sep 24 18:00:31 devstack cinder-volume[76404]: DEBUG oslo_db.sqlalchemy.engines [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 18:00:31 devstack cinder-volume[76404]: DEBUG dbcounter [-] [76404] Writer thread running {{(pid=76404) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 24 18:00:31 devstack cinder-volume[76404]: INFO cinder.rpc [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 24 18:00:31 devstack cinder-volume[76404]: INFO cinder.rpc [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 24 18:00:32 devstack cinder-volume[76404]: DEBUG oslo_db.sqlalchemy.engines [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 18:00:32 devstack cinder-volume[76404]: INFO cinder.volume.manager [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Determined volume DB was empty at startup.
Sep 24 18:00:32 devstack cinder-volume[76404]: DEBUG cinder.volume.manager [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Cinder Volume DB check: vol_db_empty=True {{(pid=76404) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 24 18:00:32 devstack cinder-volume[76404]: INFO cinder.volume.manager [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 24 18:00:32 devstack cinder-volume[76404]: WARNING stevedore.named [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 24 18:00:32 devstack cinder-volume[76404]: WARNING castellan.key_manager [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 24 18:00:32 devstack cinder-volume[76404]: WARNING cinder.keymgr.conf_key_mgr [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 24 18:00:32 devstack cinder-volume[76404]: DEBUG cinder.volume.drivers.lvm [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Attempting to initialize LVM driver with the following target_driver: cinder.volume.targets.lio.LioAdm {{(pid=76404) __init__ /opt/stack/cinder/cinder/volume/drivers/lvm.py:106}}
Sep 24 18:00:32 devstack cinder-volume[76404]: DEBUG oslo_concurrency.processutils [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Running cmd (subprocess): cinder-rtstool verify {{(pid=76404) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_concurrency.processutils [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] CMD "cinder-rtstool verify" returned: 0 in 1.150s {{(pid=76404) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_db.sqlalchemy.engines [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 18:00:33 devstack cinder-volume[76404]: INFO cinder.rpc [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Automatically selected cinder-volume objects version 1.39 as minimum service version.
Sep 24 18:00:33 devstack cinder-volume[76404]: INFO cinder.rpc [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Automatically selected cinder-volume RPC version 3.20 as minimum service version.
Sep 24 18:00:33 devstack cinder-volume[76404]: WARNING stevedore.named [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 24 18:00:33 devstack cinder-volume[76404]: WARNING castellan.key_manager [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 24 18:00:33 devstack cinder-volume[76404]: INFO cinder.volume.manager [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Image-volume cache enabled for host devstack@lvmdriver-1.
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_db.sqlalchemy.engines [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76404) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 18:00:33 devstack cinder-volume[76404]: INFO oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Starting 1 workers
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Started child 76504 {{(pid=76404) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Full set of CONF: {{(pid=76404) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] ******************************************************************************** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Configuration options gathered from: {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] ================================================================================ {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] allow_availability_zone_fallback = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] allow_compression_on_image_upload = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] allowed_direct_url_schemes     = [] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] api_rate_limit                 = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] auth_strategy                  = keystone {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] az_cache_duration              = 3600 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_availability_zone      = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_host                   = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_name                   = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_stats_polling_interval = 60 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backup_api_class               = cinder.backup.api.API {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backup_name_template           = backup-%s {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backup_use_same_host           = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backup_use_temp_snapshot       = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] chap_password                  = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] chap_username                  =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cinder_internal_tenant_project_id = 9c0c254c8df6488f8f34155ecf45687f {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cinder_internal_tenant_user_id = f390933d4fd34b7e866b0714d544eea1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cloned_volume_same_az          = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cluster                        = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] compression_format             = gzip {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] compute_api_class              = cinder.compute.nova.API {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] config_dir                     = [] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] config_source                  = [] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] control_exchange               = openstack {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] debug                          = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] default_availability_zone      = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] default_group_type             = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] default_volume_type            = lvmdriver-1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] driver_client_cert             = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] driver_client_cert_key         = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:33 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] driver_data_namespace          = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] driver_ssl_cert_path           = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] driver_ssl_cert_verify         = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] driver_use_ssl                 = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] enable_force_upload            = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] enable_new_services            = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] enable_unsupported_driver      = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] enabled_backends               = ['lvmdriver-1'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] enforce_multipath_for_image_xfer = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] filter_function                = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance_api_insecure            = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance_api_servers             = ['http://192.168.122.25/image'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance_api_ssl_compression     = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance_ca_certificates_file    = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76504]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance_catalog_info            = image:glance:publicURL {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance_certfile                = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance_keyfile                 = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance_num_retries             = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance_request_timeout         = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] goodness_function              = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] graceful_shutdown_timeout      = 5 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] group_api_class                = cinder.group.api.API {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] host                           = devstack {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] image_compress_on_upload       = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] image_conversion_address_space_limit = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] image_conversion_cpu_limit     = 60 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] image_conversion_disable       = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] image_upload_use_cinder_backend = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] image_upload_use_internal_tenant = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] image_volume_cache_enabled     = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] image_volume_cache_max_count   = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] image_volume_cache_max_size_gb = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] init_host_max_objects_retrieval = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] instance_format                = [instance: %(uuid)s]  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] iscsi_iotype                   = fileio {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] iscsi_target_flags             =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] iscsi_write_cache              = on {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] iser_helper                    = tgtadm {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] iser_ip_address                = 192.168.122.25 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] iser_port                      = 3260 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] log_color                      = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] log_config_append              = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] log_dir                        = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] log_file                       = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] log_options                    = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] log_rotate_interval            = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] log_rotate_interval_type       = days {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] log_rotation_type              = none {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] max_age                        = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] max_logfile_count              = 30 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] max_logfile_size_mb            = 200 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] max_over_subscription_ratio    = 20.0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] message_reap_interval          = 86400 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] message_ttl                    = 2592000 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] migration_create_volume_timeout_secs = 300 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] monkey_patch                   = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] monkey_patch_modules           = [] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] my_ip                          = 192.168.122.25 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] no_snapshot_gb_quota           = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] num_iser_scan_tries            = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] num_shell_tries                = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] num_volume_device_scan_tries   = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] nvmeof_conn_info_version       = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] nvmet_ns_id                    = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] nvmet_port_id                  = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] osapi_max_limit                = 1000 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] osapi_volume_ext_list          = [] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] osapi_volume_listen            = 0.0.0.0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] osapi_volume_listen_port       = 8776 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] osapi_volume_use_ssl           = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] osapi_volume_workers           = 2 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] per_volume_size_limit          = -1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] periodic_fuzzy_delay           = 60 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] periodic_interval              = 60 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] project_id_regex               = [0-9a-f\-]+ {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] public_endpoint                = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] publish_errors                 = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] quota_backup_gigabytes         = 1000 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] quota_backups                  = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] quota_gigabytes                = 1000 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] quota_groups                   = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] quota_snapshots                = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] quota_volumes                  = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] rate_limit_burst               = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] rate_limit_except_level        = CRITICAL {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] rate_limit_interval            = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] reinit_driver_count            = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] replication_device             = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] report_discard_supported       = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] report_interval                = 120 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] reservation_clean_interval     = 86400 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] reservation_expire             = 86400 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] reserved_image_namespaces      = [] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] reserved_percentage            = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] rpc_response_timeout           = 120 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] run_external_periodic_tasks    = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] scst_target_driver             = iscsi {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] scst_target_iqn_name           = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] service_down_time              = 720 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] shell_completion               = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] snapshot_name_template         = snapshot-%s {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] snapshot_same_host             = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] split_loggers                  = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] state_path                     = /opt/stack/data/cinder {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] storage_availability_zone      = nova {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] storage_protocol               = iSCSI {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] syslog_log_facility            = LOG_USER {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] target_helper                  = lioadm {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] target_ip_address              = 192.168.122.25 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] target_port                    = 3260 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] target_protocol                = iscsi {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] target_secondary_ip_addresses  = [] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] trace_flags                    = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] transfer_api_class             = cinder.transfer.api.API {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] transport_url                  = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] until_refresh                  = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] use_chap_auth                  = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] use_default_quota_class        = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] use_journal                    = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] use_json                       = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] use_multipath_for_image_xfer   = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] use_stderr                     = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] use_syslog                     = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] verify_glance_signatures       = enabled {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volume_api_class               = cinder.volume.api.API {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volume_backend_name            = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volume_clear                   = zero {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volume_clear_ionice            = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volume_clear_size              = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volume_copy_bps_limit          = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volume_dd_blocksize            = 1M {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volume_name_template           = volume-%s {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volume_service_inithost_offload = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volume_usage_audit_period      = month {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] watch_log_file                 = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] zoning_mode                    = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] os_brick.wait_mpath_device_interval = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_concurrency.disable_process_locking = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.admin_password = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.admin_tenant_name = admin {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.admin_token = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.admin_user  = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.auth_admin_prefix =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.auth_port   = 35357 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.auth_protocol = https {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.auth_section = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.auth_type   = password {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.auth_uri    = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.auth_version = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.cache       = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.certfile    = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.delay_auth_decision = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.http_connect_timeout = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.identity_uri = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.include_service_catalog = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.insecure    = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.interface   = public {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.keyfile     = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_password =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_secret_key = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_security_strategy = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcache_username =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.region_name = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.service_token_roles_required = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.service_type = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.token_cache_time = 300 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] keystone_authtoken.www_authenticate_uri = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.backend                  = dogpile.cache.null {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.backend_argument         = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.backend_expiration_time  = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.config_prefix            = cache.oslo {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.dead_timeout             = 60.0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.debug_cache_backend      = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.enable_retry_client      = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.enable_socket_keepalive  = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.enabled                  = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.enforce_fips_mode        = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.expiration_time          = 600 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.hashclient_retry_attempts = 2 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.hashclient_retry_delay   = 1.0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.memcache_dead_retry      = 300 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.memcache_password        = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.memcache_pool_maxsize    = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.memcache_pool_unused_timeout = 60 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.memcache_sasl_enabled    = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.memcache_socket_timeout  = 1.0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.memcache_username        = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.proxies                  = [] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.redis_db                 = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.redis_password           = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.redis_sentinel_service_name = mymaster {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.redis_server             = localhost:6379 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.redis_socket_timeout     = 1.0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.redis_username           = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.retry_attempts           = 2 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.retry_delay              = 0.0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.socket_keepalive_count   = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.socket_keepalive_idle    = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.socket_keepalive_interval = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.tls_allowed_ciphers      = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.tls_cafile               = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.tls_certfile             = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.tls_enabled              = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cache.tls_keyfile              = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] coordination.backend_url       = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.asyncio_connection    = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.asyncio_slave_connection = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.backend               = sqlalchemy {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.connection            = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.connection_debug      = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.connection_parameters =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.connection_recycle_time = 3600 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.connection_trace      = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.db_inc_retry_interval = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.db_max_retries        = 20 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.db_max_retry_interval = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.db_retry_interval     = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.max_overflow          = 50 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.max_pool_size         = 5 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.max_retries           = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.mysql_wsrep_sync_wait = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.pool_timeout          = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.retry_interval        = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.slave_connection      = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.sqlite_synchronous    = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] database.use_db_reconnect      = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler.connection_string     = messaging:// {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler.enabled               = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler.es_doc_type           = notification {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler.es_scroll_size        = 10000 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler.es_scroll_time        = 2m {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler.filter_error_trace    = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler.hmac_keys             = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler.sentinel_service_name = mymaster {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler.socket_timeout        = 0.1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler.trace_requests        = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler.trace_sqlalchemy      = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler_jaeger.process_tags   = {} {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler_jaeger.service_name_prefix = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] profiler_otlp.service_name_prefix = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_policy.enforce_new_defaults = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76504]: INFO cinder.volume.manager [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Starting volume driver LVMVolumeDriver (3.0.0)
Sep 24 18:00:34 devstack cinder-volume[76404]: WARNING oslo_config.cfg [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_policy.enforce_scope      = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_policy.policy_default_rule = default {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_policy.policy_file        = policy.yaml {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_policy.remote_timeout     = 60.0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] privsep_osbrick.group          = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] privsep_osbrick.helper_command = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] privsep_osbrick.log_daemon_traceback = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] privsep_osbrick.thread_pool_size = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] privsep_osbrick.user           = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cinder_sys_admin.group         = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cinder_sys_admin.helper_command = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] cinder_sys_admin.user          = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] service_user.auth_section      = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] service_user.auth_type         = password {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] service_user.certfile          = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] service_user.collect_timing    = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] service_user.insecure          = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] service_user.keyfile           = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] service_user.send_service_user_token = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] service_user.split_loggers     = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] service_user.timeout           = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance.auth_section            = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance.auth_type               = password {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance.certfile                = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance.collect_timing          = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance.insecure                = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance.keyfile                 = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance.split_loggers           = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] glance.timeout                 = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.backend_availability_zone = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.chap_password = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.chap_username =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.driver_client_cert = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.driver_client_cert_key = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.driver_data_namespace = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.driver_ssl_cert_path = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.driver_use_ssl = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.enable_unsupported_driver = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.extra_capabilities = {} {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.filter_function = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.goodness_function = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.image_volume_cache_enabled = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.iscsi_iotype  = fileio {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.iscsi_target_flags =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.iscsi_write_cache = on {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.iser_helper   = tgtadm {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.iser_port     = 3260 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.lvm_conf_file = /etc/cinder/lvm.conf {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.lvm_mirrors   = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.lvm_share_target = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.lvm_suppress_fd_warnings = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.lvm_type      = auto {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.num_shell_tries = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.nvmet_port_id = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.replication_device = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.report_discard_supported = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.reserved_percentage = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.scst_target_driver = iscsi {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.scst_target_iqn_name = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.storage_protocol = iSCSI {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.target_helper = tgtadm {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.target_port   = 3260 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.target_protocol = iscsi {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.trace_flags   = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.unique_fqdn_network = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.use_chap_auth = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.volume_backend_name = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.volume_clear  = zero {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.volume_clear_ionice = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.volume_clear_size = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.volume_group  = cinder-volumes {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_reports.file_event_handler = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_reports.file_event_handler_interval = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_reports.log_dir           = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.backend_availability_zone = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.backend_host       = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.backend_native_threads_pool_size = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.backup_use_temp_snapshot = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.chap_password      = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.chap_username      = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.chiscsi_conf       = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.driver_client_cert = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.driver_client_cert_key = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.driver_data_namespace = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.driver_ssl_cert_path = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.driver_ssl_cert_verify = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.driver_use_ssl     = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.enable_unsupported_driver = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.enforce_multipath_for_image_xfer = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.extra_capabilities = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.filter_function    = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.goodness_function  = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.image_upload_use_cinder_backend = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.image_upload_use_internal_tenant = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.image_volume_cache_enabled = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.image_volume_cache_max_count = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.image_volume_cache_max_size_gb = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.iscsi_iotype       = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.iscsi_target_flags = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.iscsi_write_cache  = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.iser_helper        = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.iser_ip_address    = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.iser_port          = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.iser_target_prefix = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.lvm_conf_file      = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.lvm_mirrors        = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.lvm_share_target   = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.lvm_suppress_fd_warnings = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.lvm_type           = auto {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.max_over_subscription_ratio = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.num_iser_scan_tries = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.num_shell_tries    = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.num_volume_device_scan_tries = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.nvmeof_conn_info_version = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.nvmet_ns_id        = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.nvmet_port_id      = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.replication_device = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.report_discard_supported = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.reserved_percentage = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.scst_target_driver = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.scst_target_iqn_name = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.storage_protocol   = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.suppress_requests_ssl_warnings = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.target_helper      = lioadm {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.target_ip_address  = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.target_port        = 3260 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.target_prefix      = iqn.2010-10.org.openstack: {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.target_protocol    = iscsi {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.target_secondary_ip_addresses = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.trace_flags        = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.unique_fqdn_network = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.use_chap_auth      = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.use_multipath_for_image_xfer = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.volume_backend_name = lvmdriver-1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.volume_clear       = zero {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.volume_clear_ionice = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.volume_clear_size  = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.volume_copy_blkio_cgroup_name = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.volume_copy_bps_limit = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.volume_dd_blocksize = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.volume_driver      = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.volume_group       = stack-volumes-lvmdriver-1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] lvmdriver-1.volumes_dir        = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.hostname = devstack {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.ssl      = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.ssl_version =  {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_notifications.driver = [] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_notifications.retry = -1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] oslo_messaging_notifications.transport_url = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] key_manager.fixed_key          = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.barbican_api_version  = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.barbican_endpoint     = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.barbican_endpoint_type = public {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.barbican_region_name  = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.cafile                = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.certfile              = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.collect_timing        = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.insecure              = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.keyfile               = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.number_of_retries     = 60 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.retry_delay           = 1 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.send_service_user_token = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.split_loggers         = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.timeout               = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.verify_ssl            = True {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican.verify_ssl_path       = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican_service_user.auth_section = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican_service_user.auth_type = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican_service_user.cafile   = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican_service_user.certfile = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican_service_user.collect_timing = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican_service_user.insecure = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican_service_user.keyfile  = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican_service_user.split_loggers = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] barbican_service_user.timeout  = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] vault.approle_role_id          = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] vault.approle_secret_id        = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] vault.kv_mountpoint            = secret {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] vault.kv_path                  = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] vault.kv_version               = 2 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] vault.namespace                = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] vault.root_token_id            = **** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] vault.ssl_ca_crt_file          = None {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.247s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] vault.timeout                  = 60.0 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] vault.use_ssl                  = False {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:00:34 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] ******************************************************************************** {{(pid=76404) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 24 18:00:34 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): env LC_ALL=C lvm version {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:34 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "env LC_ALL=C lvm version" returned: 0 in 0.121s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:34 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:35 devstack sudo[76551]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1
Sep 24 18:00:35 devstack sudo[76551]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:00:37 devstack sudo[76551]: pam_unix(sudo:session): session closed for user root
Sep 24 18:00:37 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings -o name stack-volumes-lvmdriver-1" returned: 0 in 2.153s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:37 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:37 devstack sudo[76695]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:00:37 devstack sudo[76695]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:00:39 devstack sudo[76695]: pam_unix(sudo:session): session closed for user root
Sep 24 18:00:39 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 5 in 1.972s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:39 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] 'sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' failed. Not Retrying. {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:00:39 devstack cinder-volume[76504]: INFO cinder.brick.local_dev.lvm [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Logical Volume not found when querying LVM info. (vg_name=stack-volumes-lvmdriver-1, lv_name=stack-volumes-lvmdriver-1-pool
Sep 24 18:00:39 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:39 devstack sudo[76784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 18:00:39 devstack sudo[76784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:00:41 devstack sudo[76784]: pam_unix(sudo:session): session closed for user root
Sep 24 18:00:41 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.004s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:41 devstack cinder-volume[76504]: DEBUG cinder.brick.local_dev.lvm [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Creating thin pool 'stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool' with size 28.5g of total 30.0g {{(pid=76504) create_thin_pool /opt/stack/cinder/cinder/brick/local_dev/lvm.py:479}}
Sep 24 18:00:41 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:41 devstack sudo[76874]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:00:41 devstack sudo[76874]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:00:43 devstack cinder-volume[76404]: DEBUG dbcounter [-] [76404] Writing DB stats cinder:SELECT=8,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76404) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:00:44 devstack sudo[76874]: pam_unix(sudo:session): session closed for user root
Sep 24 18:00:44 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvcreate -T -L 28.5g stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.437s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:44 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:44 devstack sudo[77068]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:00:44 devstack sudo[77068]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:00:46 devstack sudo[77068]: pam_unix(sudo:session): session closed for user root
Sep 24 18:00:46 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf lvchange -a y --yes -K stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.209s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:46 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:46 devstack sudo[77105]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster
Sep 24 18:00:46 devstack sudo[77105]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:00:48 devstack sudo[77105]: pam_unix(sudo:session): session closed for user root
Sep 24 18:00:48 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C pvs --noheadings --unit=g -o vg_name,name,size,free --separator | --nosuffix --ignoreskippedcluster" returned: 0 in 2.077s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:48 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:49 devstack sudo[77141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 18:00:49 devstack sudo[77141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:00:51 devstack sudo[77141]: pam_unix(sudo:session): session closed for user root
Sep 24 18:00:52 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 3.048s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:52 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:52 devstack sudo[77229]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 18:00:52 devstack sudo[77229]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:00:54 devstack sudo[77229]: pam_unix(sudo:session): session closed for user root
Sep 24 18:00:54 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.258s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:54 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:54 devstack sudo[77232]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:00:54 devstack sudo[77232]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:00:57 devstack sudo[77232]: pam_unix(sudo:session): session closed for user root
Sep 24 18:00:57 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.975s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:00:57 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:00:57 devstack sudo[77244]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:00:57 devstack sudo[77244]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:00 devstack sudo[77244]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:00 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 3.313s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:00 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:00 devstack sudo[77281]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:01:00 devstack sudo[77281]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:03 devstack sudo[77281]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:03 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.426s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:03 devstack cinder-volume[76504]: INFO cinder.volume.drivers.lvm [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Enabling LVM thin provisioning by default because a thin pool exists.
Sep 24 18:01:03 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:03 devstack sudo[77338]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:01:03 devstack sudo[77338]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:05 devstack sudo[77338]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:05 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.106s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:05 devstack cinder-volume[76504]: DEBUG cinder.volume.drivers.lvm [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Updating volume stats {{(pid=76504) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 18:01:05 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:05 devstack sudo[77418]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 18:01:05 devstack sudo[77418]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:07 devstack sudo[77418]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:07 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.030s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:07 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:07 devstack sudo[77543]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:01:07 devstack sudo[77543]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:09 devstack sudo[77543]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:09 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.913s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:09 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:09 devstack sudo[77546]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:01:09 devstack sudo[77546]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:11 devstack sudo[77546]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:11 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.979s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:11 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:11 devstack sudo[77549]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:01:11 devstack sudo[77549]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:13 devstack sudo[77549]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:13 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.092s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:13 devstack cinder-volume[76504]: INFO cinder.volume.driver [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Driver hasn't implemented _init_vendor_properties()
Sep 24 18:01:13 devstack cinder-volume[76504]: DEBUG cinder.volume.driver [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Initialized capabilities list: {'volume_backend_name': 'lvmdriver-1', 'vendor_name': 'Open Source', 'driver_version': '3.0.0', 'storage_protocol': 'iSCSI', 'pools': [{'pool_name': 'lvmdriver-1', 'total_capacity_gb': 28.5, 'free_capacity_gb': 28.5, 'reserved_percentage': 0, 'location_info': 'LVMVolumeDriver:devstack:stack-volumes-lvmdriver-1:thin:0', 'QoS_support': False, 'provisioned_capacity_gb': 0.0, 'max_over_subscription_ratio': '20.0', 'thin_provisioning_support': True, 'thick_provisioning_support': False, 'total_volumes': 1, 'filter_function': None, 'goodness_function': None, 'multiattach': True, 'backend_state': 'up'}], 'shared_targets': False, 'sparse_copy_volume': True, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=76504) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 24 18:01:13 devstack cinder-volume[76504]: DEBUG oslo_db.sqlalchemy.engines [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=76504) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 18:01:13 devstack cinder-volume[76504]: DEBUG dbcounter [-] [76504] Writer thread running {{(pid=76504) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 24 18:01:13 devstack cinder-volume[76504]: DEBUG cinder.db.sqlalchemy.api [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Building query based on filter {{(pid=76504) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 24 18:01:13 devstack cinder-volume[76504]: DEBUG cinder.image.image_utils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=76504) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 24 18:01:13 devstack cinder-volume[76504]: INFO cinder.keymgr.migration [None req-67a871f7-cbb3-49c7-b33a-1440e43810c7 None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 24 18:01:14 devstack cinder-volume[76504]: DEBUG cinder.volume.drivers.lvm [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Updating volume stats {{(pid=76504) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 18:01:14 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:14 devstack sudo[77556]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 18:01:14 devstack sudo[77556]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:16 devstack sudo[77556]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:16 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.267s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:16 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:16 devstack sudo[77587]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:01:16 devstack sudo[77587]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:18 devstack sudo[77587]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:18 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.079s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:18 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:18 devstack sudo[77693]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:01:18 devstack sudo[77693]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:20 devstack sudo[77693]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:20 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.364s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:20 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:20 devstack sudo[77709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:01:20 devstack sudo[77709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:23 devstack sudo[77709]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:23 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.191s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:23 devstack cinder-volume[76504]: DEBUG cinder.manager [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Notifying Schedulers of capabilities ... {{(pid=76504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:01:23 devstack cinder-volume[76504]: INFO cinder.volume.manager [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Driver initialization completed successfully.
Sep 24 18:01:23 devstack cinder-volume[76504]: INFO cinder.manager [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Initiating service 2 cleanup
Sep 24 18:01:23 devstack cinder-volume[76504]: INFO cinder.manager [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Service 2 cleanup completed.
Sep 24 18:01:23 devstack cinder-volume[76504]: DEBUG cinder.service [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Creating RPC server for service cinder-volume {{(pid=76504) start /opt/stack/cinder/cinder/service.py:239}}
Sep 24 18:01:23 devstack cinder-volume[76504]: DEBUG cinder.service [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=76504) start /opt/stack/cinder/cinder/service.py:245}}
Sep 24 18:01:23 devstack cinder-volume[76504]: INFO cinder.volume.manager [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Initializing RPC dependent components of volume driver LVMVolumeDriver (3.0.0)
Sep 24 18:01:23 devstack cinder-volume[76504]: DEBUG cinder.volume.drivers.lvm [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Updating volume stats {{(pid=76504) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 18:01:23 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:23 devstack sudo[77712]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 18:01:23 devstack sudo[77712]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:24 devstack cinder-volume[76504]: DEBUG dbcounter [-] [76504] Writing DB stats cinder:SELECT=10,cinder:INSERT=1,cinder:UPDATE=1 {{(pid=76504) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:01:25 devstack sudo[77712]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:25 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.941s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:25 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:25 devstack sudo[77722]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:01:25 devstack sudo[77722]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:27 devstack sudo[77722]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:27 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.230s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:27 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:27 devstack sudo[77725]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:01:27 devstack sudo[77725]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:29 devstack sudo[77725]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:29 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.008s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:29 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:01:29 devstack sudo[77732]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:01:29 devstack sudo[77732]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:01:31 devstack sudo[77732]: pam_unix(sudo:session): session closed for user root
Sep 24 18:01:31 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.096s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:01:32 devstack cinder-volume[76504]: INFO cinder.volume.manager [None req-000b135d-86a5-44b4-86cb-b9b2766ee1ea None None] Driver post RPC initialization completed successfully.
Sep 24 18:01:41 devstack cinder-volume[76504]: DEBUG dbcounter [-] [76504] Writing DB stats cinder:SELECT=1 {{(pid=76504) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:01:42 devstack cinder-volume[76504]: DEBUG dbcounter [-] [76504] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=76504) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:02:16 devstack cinder-volume[76504]: DEBUG oslo_service.periodic_task [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76504) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:02:16 devstack cinder-volume[76504]: DEBUG cinder.volume.drivers.lvm [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Updating volume stats {{(pid=76504) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 18:02:16 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:16 devstack sudo[78709]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 18:02:16 devstack sudo[78709]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:02:18 devstack sudo[78709]: pam_unix(sudo:session): session closed for user root
Sep 24 18:02:18 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.618s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:18 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:18 devstack sudo[78714]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:02:18 devstack sudo[78714]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:02:21 devstack sudo[78714]: pam_unix(sudo:session): session closed for user root
Sep 24 18:02:21 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.483s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:21 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:21 devstack sudo[78718]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:02:21 devstack sudo[78718]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:02:23 devstack sudo[78718]: pam_unix(sudo:session): session closed for user root
Sep 24 18:02:23 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.508s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:23 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:02:23 devstack sudo[78731]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:02:23 devstack sudo[78731]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:02:25 devstack sudo[78731]: pam_unix(sudo:session): session closed for user root
Sep 24 18:02:25 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.098s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:02:25 devstack cinder-volume[76504]: DEBUG cinder.manager [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Notifying Schedulers of capabilities ... {{(pid=76504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:03:16 devstack cinder-volume[76504]: DEBUG oslo_service.periodic_task [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76504) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:03:16 devstack cinder-volume[76504]: DEBUG cinder.volume.drivers.lvm [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Updating volume stats {{(pid=76504) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 18:03:16 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:03:16 devstack sudo[79477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 18:03:16 devstack sudo[79477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:03:18 devstack sudo[79477]: pam_unix(sudo:session): session closed for user root
Sep 24 18:03:18 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 1.993s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:03:18 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:03:18 devstack sudo[79480]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:03:18 devstack sudo[79480]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:03:20 devstack sudo[79480]: pam_unix(sudo:session): session closed for user root
Sep 24 18:03:20 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.021s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:03:20 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:03:20 devstack sudo[79483]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:03:20 devstack sudo[79483]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:03:22 devstack sudo[79483]: pam_unix(sudo:session): session closed for user root
Sep 24 18:03:22 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.378s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:03:22 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:03:22 devstack sudo[79505]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:03:22 devstack sudo[79505]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:03:24 devstack sudo[79505]: pam_unix(sudo:session): session closed for user root
Sep 24 18:03:24 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.998s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:03:24 devstack cinder-volume[76504]: DEBUG cinder.manager [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Notifying Schedulers of capabilities ... {{(pid=76504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:03:42 devstack cinder-volume[76504]: DEBUG dbcounter [-] [76504] Writing DB stats cinder:SELECT=1 {{(pid=76504) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:03:42 devstack cinder-volume[76504]: DEBUG dbcounter [-] [76504] Writing DB stats cinder:UPDATE=1 {{(pid=76504) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:04:16 devstack cinder-volume[76504]: DEBUG oslo_service.periodic_task [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76504) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:04:16 devstack cinder-volume[76504]: DEBUG cinder.volume.drivers.lvm [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Updating volume stats {{(pid=76504) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 18:04:16 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:04:16 devstack sudo[81137]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 18:04:16 devstack sudo[81137]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:04:18 devstack sudo[81137]: pam_unix(sudo:session): session closed for user root
Sep 24 18:04:18 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.244s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:04:18 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:04:18 devstack sudo[81302]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:04:18 devstack sudo[81302]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:04:20 devstack sudo[81302]: pam_unix(sudo:session): session closed for user root
Sep 24 18:04:20 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.300s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:04:20 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:04:20 devstack sudo[81452]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:04:20 devstack sudo[81452]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:04:22 devstack sudo[81452]: pam_unix(sudo:session): session closed for user root
Sep 24 18:04:22 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.085s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:04:22 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:04:22 devstack sudo[81604]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:04:22 devstack sudo[81604]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:04:24 devstack sudo[81604]: pam_unix(sudo:session): session closed for user root
Sep 24 18:04:24 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.001s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:04:24 devstack cinder-volume[76504]: DEBUG cinder.manager [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Notifying Schedulers of capabilities ... {{(pid=76504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:05:16 devstack cinder-volume[76504]: DEBUG oslo_service.periodic_task [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76504) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:05:16 devstack cinder-volume[76504]: DEBUG cinder.volume.drivers.lvm [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Updating volume stats {{(pid=76504) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 18:05:16 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:05:16 devstack sudo[82773]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 18:05:16 devstack sudo[82773]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:05:18 devstack sudo[82773]: pam_unix(sudo:session): session closed for user root
Sep 24 18:05:18 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.281s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:05:18 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:05:18 devstack sudo[82784]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:05:18 devstack sudo[82784]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:05:20 devstack sudo[82784]: pam_unix(sudo:session): session closed for user root
Sep 24 18:05:20 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.271s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:05:20 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:05:20 devstack sudo[82791]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:05:20 devstack sudo[82791]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:05:22 devstack sudo[82791]: pam_unix(sudo:session): session closed for user root
Sep 24 18:05:22 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 1.931s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:05:22 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:05:22 devstack sudo[82797]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:05:22 devstack sudo[82797]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:05:24 devstack sudo[82797]: pam_unix(sudo:session): session closed for user root
Sep 24 18:05:24 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.984s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:05:24 devstack cinder-volume[76504]: DEBUG cinder.manager [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Notifying Schedulers of capabilities ... {{(pid=76504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:05:42 devstack cinder-volume[76504]: DEBUG dbcounter [-] [76504] Writing DB stats cinder:SELECT=1 {{(pid=76504) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:05:42 devstack cinder-volume[76504]: DEBUG dbcounter [-] [76504] Writing DB stats cinder:UPDATE=1 {{(pid=76504) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:06:16 devstack cinder-volume[76504]: DEBUG oslo_service.periodic_task [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=76504) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:06:16 devstack cinder-volume[76504]: DEBUG cinder.volume.drivers.lvm [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Updating volume stats {{(pid=76504) _update_volume_stats /opt/stack/cinder/cinder/volume/drivers/lvm.py:227}}
Sep 24 18:06:16 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:06:16 devstack sudo[82992]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1
Sep 24 18:06:16 devstack sudo[82992]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:06:18 devstack sudo[82992]: pam_unix(sudo:session): session closed for user root
Sep 24 18:06:18 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C vgs --noheadings --unit=g -o name,size,free,lv_count,uuid --separator : --nosuffix stack-volumes-lvmdriver-1" returned: 0 in 2.117s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:06:18 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:06:18 devstack sudo[82997]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:06:18 devstack sudo[82997]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:06:20 devstack sudo[82997]: pam_unix(sudo:session): session closed for user root
Sep 24 18:06:20 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 2.289s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:06:20 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:06:20 devstack sudo[83004]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool
Sep 24 18:06:20 devstack sudo[83004]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:06:22 devstack sudo[83004]: pam_unix(sudo:session): session closed for user root
Sep 24 18:06:22 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o size,data_percent --separator : --nosuffix /dev/stack-volumes-lvmdriver-1/stack-volumes-lvmdriver-1-pool" returned: 0 in 2.017s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:06:22 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Running cmd (subprocess): sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1 {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:06:22 devstack sudo[83009]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1
Sep 24 18:06:22 devstack sudo[83009]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:06:24 devstack sudo[83009]: pam_unix(sudo:session): session closed for user root
Sep 24 18:06:24 devstack cinder-volume[76504]: DEBUG oslo_concurrency.processutils [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] CMD "sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C lvs --noheadings --unit=g -o vg_name,name,size --nosuffix --readonly stack-volumes-lvmdriver-1" returned: 0 in 1.859s {{(pid=76504) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:06:24 devstack cinder-volume[76504]: DEBUG cinder.manager [None req-811ab111-f992-4225-8f9d-f3a1749d7f0f None None] Notifying Schedulers of capabilities ... {{(pid=76504) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:07:06 devstack cinder-volume[76404]: INFO oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Caught SIGTERM, stopping children
Sep 24 18:07:06 devstack cinder-volume[76404]: DEBUG oslo_concurrency.lockutils [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Acquiring lock "singleton_lock" {{(pid=76404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 24 18:07:06 devstack cinder-volume[76404]: DEBUG oslo_concurrency.lockutils [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Acquired lock "singleton_lock" {{(pid=76404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 24 18:07:06 devstack cinder-volume[76404]: DEBUG oslo_concurrency.lockutils [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Releasing lock "singleton_lock" {{(pid=76404) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 24 18:07:06 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Stop services. {{(pid=76404) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:610}}
Sep 24 18:07:06 devstack cinder-volume[76404]: DEBUG oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Killing children. {{(pid=76404) stop /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:615}}
Sep 24 18:07:06 devstack cinder-volume[76404]: INFO oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Waiting on 1 children to exit
Sep 24 18:07:08 devstack cinder-volume[76504]: DEBUG oslo_concurrency.lockutils [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Acquiring lock "singleton_lock" {{(pid=76504) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 24 18:07:08 devstack cinder-volume[76504]: DEBUG oslo_concurrency.lockutils [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Acquired lock "singleton_lock" {{(pid=76504) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 24 18:07:08 devstack cinder-volume[76504]: DEBUG oslo_concurrency.lockutils [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Releasing lock "singleton_lock" {{(pid=76504) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 24 18:07:08 devstack cinder-volume[76504]: WARNING amqp [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 24 18:07:08 devstack cinder-volume[76504]: WARNING amqp [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Received method (60, 30) during closing channel 1. This method will be ignored
Sep 24 18:07:08 devstack cinder-volume[76404]: INFO oslo_service.backend._eventlet.service [None req-f2de42c4-e364-4d86-a2e7-f37eef7d0ade None None] Child 76504 exited with status 0
Sep 24 18:07:27 devstack cinder-volume[83960]: DEBUG oslo_concurrency.lockutils [-] Acquiring lock "singleton_lock" {{(pid=83960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:313}}
Sep 24 18:07:27 devstack cinder-volume[83960]: DEBUG oslo_concurrency.lockutils [-] Acquired lock "singleton_lock" {{(pid=83960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:316}}
Sep 24 18:07:27 devstack cinder-volume[83960]: DEBUG oslo_concurrency.lockutils [-] Releasing lock "singleton_lock" {{(pid=83960) lock /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:334}}
Sep 24 18:07:30 devstack cinder-volume[83960]: INFO dbcounter [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Registered counter for database cinder
Sep 24 18:07:30 devstack cinder-volume[83960]: DEBUG oslo_db.sqlalchemy.engines [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83960) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 18:07:30 devstack cinder-volume[83960]: DEBUG dbcounter [-] [83960] Writer thread running {{(pid=83960) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 24 18:07:30 devstack cinder-volume[83960]: INFO cinder.rpc [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Automatically selected cinder-scheduler objects version 1.39 as minimum service version.
Sep 24 18:07:30 devstack cinder-volume[83960]: INFO cinder.rpc [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Automatically selected cinder-scheduler RPC version 3.12 as minimum service version.
Sep 24 18:07:30 devstack cinder-volume[83960]: DEBUG oslo_db.sqlalchemy.engines [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83960) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 18:07:31 devstack cinder-volume[83960]: INFO cinder.volume.manager [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Determined volume DB was empty at startup.
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG cinder.volume.manager [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Cinder Volume DB check: vol_db_empty=True {{(pid=83960) __init__ /opt/stack/cinder/cinder/volume/manager.py:288}}
Sep 24 18:07:31 devstack cinder-volume[83960]: INFO cinder.volume.manager [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Service not found for updating active_backend_id, assuming default for driver init.
Sep 24 18:07:31 devstack cinder-volume[83960]: WARNING stevedore.named [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Could not load cinder.keymgr.conf_key_mgr.ConfKeyManager
Sep 24 18:07:31 devstack cinder-volume[83960]: WARNING castellan.key_manager [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Deprecation Warning : cinder.keymgr.conf_key_mgr.ConfKeyManager is not a stevedore based driver, trying to load it as a class: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 24 18:07:31 devstack cinder-volume[83960]: WARNING cinder.keymgr.conf_key_mgr [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] This key manager is insecure and is not recommended for production deployments: stevedore.exception.NoMatches: No 'castellan.drivers' driver found, looking for 'cinder.keymgr.conf_key_mgr.ConfKeyManager'
Sep 24 18:07:31 devstack cinder-volume[83960]: INFO cinder.volume.manager [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Image-volume cache disabled for host devstack@QuobyteHD.
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_db.sqlalchemy.engines [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=83960) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 18:07:31 devstack cinder-volume[83960]: INFO oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Starting 1 workers
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Started child 84177 {{(pid=83960) _start_child /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:490}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Full set of CONF: {{(pid=83960) wait /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/backend/_eventlet/service.py:564}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] ******************************************************************************** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2804}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Configuration options gathered from: {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2805}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] command line args: ['--config-file', '/etc/cinder/cinder.conf'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2806}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] config files: ['/etc/cinder/cinder.conf'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2807}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] ================================================================================ {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2809}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] allow_availability_zone_fallback = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] allow_compression_on_image_upload = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] allowed_direct_url_schemes     = [] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] api_rate_limit                 = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] auth_strategy                  = keystone {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_availability_zone      = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_host                   = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_name                   = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_stats_polling_interval = 60 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[84177]: INFO cinder.service [-] Starting cinder-volume node (version 27.0.0)
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backup_api_class               = cinder.backup.api.API {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backup_manager                 = cinder.backup.manager.BackupManager {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backup_name_template           = backup-%s {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backup_use_same_host           = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backup_use_temp_snapshot       = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] chap_password                  = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] chap_username                  =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] chiscsi_conf                   = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cinder_internal_tenant_project_id = 9c0c254c8df6488f8f34155ecf45687f {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cinder_internal_tenant_user_id = f390933d4fd34b7e866b0714d544eea1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cluster                        = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] compression_format             = gzip {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] compute_api_class              = cinder.compute.nova.API {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] config_dir                     = [] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] config_file                    = ['/etc/cinder/cinder.conf'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] config_source                  = [] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] consistencygroup_api_class     = cinder.consistencygroup.api.API {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] control_exchange               = openstack {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] debug                          = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] default_availability_zone      = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] default_group_type             = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] default_log_levels             = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] default_volume_type            = QuobyteHD {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] driver_client_cert             = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] driver_client_cert_key         = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] driver_data_namespace          = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] driver_ssl_cert_path           = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] driver_ssl_cert_verify         = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] driver_use_ssl                 = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] enable_new_services            = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] enable_unsupported_driver      = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] enabled_backends               = ['QuobyteHD'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] enforce_multipath_for_image_xfer = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] filter_function                = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance_api_insecure            = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance_api_servers             = ['http://192.168.122.25/image'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance_api_ssl_compression     = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance_ca_certificates_file    = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance_catalog_info            = image:glance:publicURL {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance_certfile                = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance_core_properties         = ['checksum', 'container_format', 'disk_format', 'image_name', 'image_id', 'min_disk', 'min_ram', 'name', 'size'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance_keyfile                 = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance_num_retries             = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance_request_timeout         = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] goodness_function              = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] graceful_shutdown_timeout      = 5 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] group_api_class                = cinder.group.api.API {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] host                           = devstack {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] image_compress_on_upload       = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] image_conversion_address_space_limit = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] image_conversion_cpu_limit     = 60 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] image_conversion_dir           = /opt/stack/data/cinder/conversion {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] image_conversion_disable       = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] image_upload_use_cinder_backend = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] image_upload_use_internal_tenant = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] image_volume_cache_enabled     = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] image_volume_cache_max_count   = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] image_volume_cache_max_size_gb = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] init_host_max_objects_retrieval = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] instance_format                = [instance: %(uuid)s]  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] instance_uuid_format           = [instance: %(uuid)s]  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] iscsi_iotype                   = fileio {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] iscsi_target_flags             =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] iscsi_write_cache              = on {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:31 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] iser_helper                    = tgtadm {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] iser_ip_address                = 192.168.122.25 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] iser_port                      = 3260 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] iser_target_prefix             = iqn.2010-10.org.openstack: {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] log_color                      = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] log_config_append              = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] log_date_format                = %Y-%m-%d %H:%M:%S {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] log_dir                        = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] log_file                       = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] log_options                    = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] log_rotate_interval            = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] log_rotate_interval_type       = days {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] log_rotation_type              = none {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] logging_context_format_string  = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] logging_debug_format_suffix    = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] logging_default_format_string  = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] logging_exception_prefix       = ERROR %(name)s %(instance)s {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] logging_user_identity_format   = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] max_age                        = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] max_logfile_count              = 30 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] max_logfile_size_mb            = 200 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] max_over_subscription_ratio    = 20.0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] message_reap_interval          = 86400 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] message_ttl                    = 2592000 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] migration_create_volume_timeout_secs = 300 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] monkey_patch                   = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] monkey_patch_modules           = [] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] my_ip                          = 192.168.122.25 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] no_snapshot_gb_quota           = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] num_iser_scan_tries            = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] num_shell_tries                = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] num_volume_device_scan_tries   = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] nvmeof_conn_info_version       = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] nvmet_ns_id                    = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] nvmet_port_id                  = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] osapi_max_limit                = 1000 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] osapi_volume_ext_list          = [] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] osapi_volume_extension         = ['cinder.api.contrib.standard_extensions'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] osapi_volume_listen            = 0.0.0.0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] osapi_volume_listen_port       = 8776 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] osapi_volume_use_ssl           = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] osapi_volume_workers           = 2 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] per_volume_size_limit          = -1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] periodic_fuzzy_delay           = 60 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] periodic_interval              = 60 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] project_id_regex               = [0-9a-f\-]+ {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] public_endpoint                = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] publish_errors                 = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] quota_backup_gigabytes         = 1000 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] quota_backups                  = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] quota_driver                   = cinder.quota.DbQuotaDriver {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] quota_gigabytes                = 1000 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] quota_groups                   = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] quota_snapshots                = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] quota_volumes                  = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] rate_limit_burst               = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] rate_limit_except_level        = CRITICAL {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] rate_limit_interval            = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] reinit_driver_count            = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] replication_device             = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] report_discard_supported       = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] report_interval                = 120 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] reservation_clean_interval     = 86400 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] reservation_expire             = 86400 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] reserved_image_namespaces      = [] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] reserved_percentage            = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] resource_query_filters_file    = /etc/cinder/resource_filters.json {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] rootwrap_config                = /etc/cinder/rootwrap.conf {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] rpc_response_timeout           = 120 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] run_external_periodic_tasks    = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] scheduler_manager              = cinder.scheduler.manager.SchedulerManager {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] scst_target_driver             = iscsi {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] scst_target_iqn_name           = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] service_down_time              = 720 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] shell_completion               = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] snapshot_name_template         = snapshot-%s {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] split_loggers                  = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] state_path                     = /opt/stack/data/cinder {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] storage_availability_zone      = nova {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] storage_protocol               = iSCSI {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] syslog_log_facility            = LOG_USER {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] target_helper                  = lioadm {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] target_ip_address              = 192.168.122.25 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] target_port                    = 3260 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] target_prefix                  = iqn.2010-10.org.openstack: {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] target_protocol                = iscsi {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] target_secondary_ip_addresses  = [] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] trace_flags                    = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] transfer_api_class             = cinder.transfer.api.API {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] transport_url                  = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] until_refresh                  = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] use_chap_auth                  = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] use_default_quota_class        = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] use_journal                    = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] use_json                       = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] use_multipath_for_image_xfer   = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] use_stderr                     = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] use_syslog                     = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] verify_glance_signatures       = enabled {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] vmdk_allowed_types             = ['streamOptimized', 'monolithicSparse'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volume_api_class               = cinder.volume.api.API {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volume_backend_name            = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volume_clear                   = zero {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volume_clear_ionice            = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volume_clear_size              = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volume_copy_blkio_cgroup_name  = cinder-volume-copy {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volume_copy_bps_limit          = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volume_dd_blocksize            = 1M {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volume_manager                 = cinder.volume.manager.VolumeManager {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volume_name_template           = volume-%s {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volume_service_inithost_offload = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volume_usage_audit_period      = month {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] volumes_dir                    = /opt/stack/data/cinder/volumes {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] watch_log_file                 = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] zoning_mode                    = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2817}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] os_brick.lock_path             = /opt/stack/data/cinder {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] os_brick.wait_mpath_device_attempts = 4 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] os_brick.wait_mpath_device_interval = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_concurrency.disable_process_locking = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_concurrency.lock_path     = /opt/stack/data/cinder {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.admin_password = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.admin_tenant_name = admin {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.admin_token = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.admin_user  = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.auth_admin_prefix =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.auth_host   = 127.0.0.1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.auth_port   = 35357 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.auth_protocol = https {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.auth_section = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.auth_type   = password {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.auth_uri    = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.auth_version = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.cache       = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.cafile      = /opt/stack/data/ca-bundle.pem {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.certfile    = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.delay_auth_decision = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.enforce_token_bind = permissive {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.http_connect_timeout = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.http_request_max_retries = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.identity_uri = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.include_service_catalog = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.insecure    = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.interface   = public {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.keyfile     = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_password =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_pool_conn_get_timeout = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_pool_dead_retry = 300 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_pool_maxsize = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_pool_socket_timeout = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_pool_unused_timeout = 60 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_sasl_enabled = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_secret_key = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_security_strategy = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_tls_allowed_ciphers = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_tls_cafile = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_tls_certfile = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_tls_enabled = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_tls_keyfile = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_use_advanced_pool = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcache_username =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.memcached_servers = ['localhost:11211'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.region_name = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.service_token_roles = ['service'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.service_token_roles_required = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.service_type = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.token_cache_time = 300 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] keystone_authtoken.www_authenticate_uri = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.backend                  = dogpile.cache.null {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.backend_argument         = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.backend_expiration_time  = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.config_prefix            = cache.oslo {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.dead_timeout             = 60.0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.debug_cache_backend      = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.enable_retry_client      = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.enable_socket_keepalive  = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.enabled                  = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.enforce_fips_mode        = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.expiration_time          = 600 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.hashclient_retry_attempts = 2 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.hashclient_retry_delay   = 1.0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.memcache_dead_retry      = 300 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.memcache_password        = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.memcache_pool_connection_get_timeout = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.memcache_pool_flush_on_reconnect = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.memcache_pool_maxsize    = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.memcache_pool_unused_timeout = 60 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.memcache_sasl_enabled    = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.memcache_servers         = ['localhost:11211'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.memcache_socket_timeout  = 1.0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.memcache_username        = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.proxies                  = [] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.redis_db                 = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.redis_password           = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.redis_sentinel_service_name = mymaster {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.redis_sentinels          = ['localhost:26379'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.redis_server             = localhost:6379 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.redis_socket_timeout     = 1.0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.redis_username           = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.retry_attempts           = 2 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.retry_delay              = 0.0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.socket_keepalive_count   = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.socket_keepalive_idle    = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.socket_keepalive_interval = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.tls_allowed_ciphers      = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.tls_cafile               = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.tls_certfile             = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.tls_enabled              = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cache.tls_keyfile              = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] coordination.backend_url       = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.asyncio_connection    = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.asyncio_slave_connection = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.backend               = sqlalchemy {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.connection            = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.connection_debug      = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.connection_parameters =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.connection_recycle_time = 3600 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.connection_trace      = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.db_inc_retry_interval = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.db_max_retries        = 20 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.db_max_retry_interval = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.db_retry_interval     = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.max_overflow          = 50 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.max_pool_size         = 5 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.max_retries           = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.mysql_sql_mode        = TRADITIONAL {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.mysql_wsrep_sync_wait = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.pool_timeout          = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.retry_interval        = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.slave_connection      = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.sqlite_synchronous    = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] database.use_db_reconnect      = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_metrics.metrics_enabled = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_metrics.metrics_process_name =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler.connection_string     = messaging:// {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler.enabled               = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler.es_doc_type           = notification {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler.es_scroll_size        = 10000 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler.es_scroll_time        = 2m {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler.filter_error_trace    = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler.hmac_keys             = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler.sentinel_service_name = mymaster {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler.socket_timeout        = 0.1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler.trace_requests        = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler.trace_sqlalchemy      = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler_jaeger.process_tags   = {} {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler_jaeger.service_name_prefix = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] profiler_otlp.service_name_prefix = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_policy.enforce_new_defaults = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: WARNING oslo_config.cfg [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] Deprecated: Option "enforce_scope" from group "oslo_policy" is deprecated for removal (This configuration was added temporarily to facilitate a smooth transition to the new RBAC. OpenStack will always enforce scope checks. This configuration option is deprecated and will be removed in the 2025.2 cycle.).  Its value may be silently ignored in the future.
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_policy.enforce_scope      = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_policy.policy_default_rule = default {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_policy.policy_dirs        = ['policy.d'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_policy.policy_file        = policy.yaml {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_policy.remote_ssl_client_crt_file = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_policy.remote_ssl_client_key_file = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_policy.remote_timeout     = 60.0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] privsep_osbrick.capabilities   = [21, 2] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] privsep_osbrick.group          = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] privsep_osbrick.helper_command = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] privsep_osbrick.log_daemon_traceback = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] privsep_osbrick.logger_name    = os_brick.privileged {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] privsep_osbrick.thread_pool_size = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] privsep_osbrick.user           = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cinder_sys_admin.capabilities  = [0, 1, 2, 3, 12, 21] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cinder_sys_admin.group         = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cinder_sys_admin.helper_command = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cinder_sys_admin.log_daemon_traceback = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cinder_sys_admin.logger_name   = oslo_privsep.daemon {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cinder_sys_admin.thread_pool_size = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] cinder_sys_admin.user          = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] service_user.auth_section      = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] service_user.auth_type         = password {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] service_user.cafile            = /opt/stack/data/ca-bundle.pem {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] service_user.certfile          = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] service_user.collect_timing    = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] service_user.insecure          = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] service_user.keyfile           = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] service_user.send_service_user_token = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] service_user.split_loggers     = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] service_user.timeout           = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance.auth_section            = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance.auth_type               = password {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [-] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance.cafile                  = /opt/stack/data/ca-bundle.pem {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance.certfile                = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance.collect_timing          = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance.insecure                = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance.keyfile                 = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance.split_loggers           = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] glance.timeout                 = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.backend_availability_zone = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.backend_native_threads_pool_size = 20 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.backup_use_temp_snapshot = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.chap_password = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.chap_username =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.chiscsi_conf  = /etc/chelsio-iscsi/chiscsi.conf {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.driver_client_cert = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.driver_client_cert_key = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.driver_data_namespace = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.driver_ssl_cert_path = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.driver_ssl_cert_verify = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.driver_use_ssl = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.enable_unsupported_driver = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.enforce_multipath_for_image_xfer = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.extra_capabilities = {} {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.filter_function = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.goodness_function = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.image_upload_use_cinder_backend = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.image_upload_use_internal_tenant = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.image_volume_cache_enabled = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.image_volume_cache_max_count = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.image_volume_cache_max_size_gb = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.iscsi_iotype  = fileio {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.iscsi_target_flags =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.iscsi_write_cache = on {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.iser_helper   = tgtadm {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.iser_ip_address = 192.168.122.25 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.iser_port     = 3260 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.iser_target_prefix = iqn.2010-10.org.openstack: {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.max_over_subscription_ratio = 20.0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nas_host      =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nas_login     = admin {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nas_mount_options = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nas_password  = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nas_private_key =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nas_secure_file_operations = auto {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nas_secure_file_permissions = auto {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nas_share_path =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nas_ssh_port  = 22 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nas_volume_prov_type = thin {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.num_iser_scan_tries = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.num_shell_tries = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.num_volume_device_scan_tries = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nvmeof_conn_info_version = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nvmet_ns_id   = 10 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.nvmet_port_id = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.quobyte_client_cfg = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.quobyte_mount_point_base = /opt/stack/data/cinder/mnt {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.quobyte_overlay_volumes = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.quobyte_qcow2_volumes = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.quobyte_sparsed_volumes = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Starting volume driver QuobyteDriver (1.1.13)
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.quobyte_volume_from_snapshot_cache = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.quobyte_volume_url = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.replication_device = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.report_discard_supported = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.reserved_percentage = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.scst_target_driver = iscsi {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.scst_target_iqn_name = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] NAS config: {'nas_secure_file_permissions': 'true', 'nas_secure_file_operations': 'true'} {{(pid=84177) do_setup /opt/stack/cinder/cinder/volume/drivers/remotefs.py:223}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.storage_protocol = iSCSI {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.suppress_requests_ssl_warnings = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.target_helper = tgtadm {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.target_ip_address = 192.168.122.25 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.target_port   = 3260 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.target_prefix = iqn.2010-10.org.openstack: {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.target_protocol = iscsi {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.target_secondary_ip_addresses = [] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.trace_flags   = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.unique_fqdn_network = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.use_chap_auth = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.use_multipath_for_image_xfer = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.volume_backend_name = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.volume_clear  = zero {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.volume_clear_ionice = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.volume_clear_size = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.volume_copy_blkio_cgroup_name = cinder-volume-copy {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.volume_copy_bps_limit = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.volume_dd_blocksize = 1M {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.volume_driver = cinder.volume.drivers.lvm.LVMVolumeDriver {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] backend_defaults.volumes_dir   = /opt/stack/data/cinder/volumes {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_reports.file_event_handler = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_reports.file_event_handler_interval = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_reports.log_dir           = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.backend_availability_zone = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.backend_host         = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.backend_native_threads_pool_size = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.backup_use_temp_snapshot = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.chap_password        = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.chap_username        = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.chiscsi_conf         = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.driver_client_cert   = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.driver_client_cert_key = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.driver_data_namespace = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.driver_ssl_cert_path = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.driver_ssl_cert_verify = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.driver_use_ssl       = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.enable_unsupported_driver = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.enforce_multipath_for_image_xfer = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.extra_capabilities   = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.filter_function      = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.goodness_function    = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.image_upload_use_cinder_backend = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.image_upload_use_internal_tenant = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.image_volume_cache_enabled = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.image_volume_cache_max_count = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.image_volume_cache_max_size_gb = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.iscsi_iotype         = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.iscsi_target_flags   = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.iscsi_write_cache    = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.iser_helper          = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.iser_ip_address      = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.iser_port            = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.iser_target_prefix   = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.max_over_subscription_ratio = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nas_host             = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nas_login            = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nas_mount_options    = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nas_password         = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nas_private_key      = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nas_secure_file_operations = true {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nas_secure_file_permissions = true {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nas_share_path       = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nas_ssh_port         = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nas_volume_prov_type = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.num_iser_scan_tries  = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.num_shell_tries      = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.num_volume_device_scan_tries = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nvmeof_conn_info_version = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nvmet_ns_id          = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.nvmet_port_id        = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.quobyte_client_cfg   = /etc/quobyte/client-cinder.cfg {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.quobyte_mount_point_base = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.quobyte_overlay_volumes = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.quobyte_qcow2_volumes = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.quobyte_sparsed_volumes = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.quobyte_volume_from_snapshot_cache = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.quobyte_volume_url   = quobyte://10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.replication_device   = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.report_discard_supported = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.reserved_percentage  = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.scst_target_driver   = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.scst_target_iqn_name = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.storage_protocol     = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.suppress_requests_ssl_warnings = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.target_helper        = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.target_ip_address    = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.target_port          = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.target_prefix        = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.target_protocol      = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.target_secondary_ip_addresses = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.trace_flags          = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.unique_fqdn_network  = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.use_chap_auth        = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.use_multipath_for_image_xfer = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.volume_backend_name  = QuobyteHD {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.volume_clear         = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.volume_clear_ionice  = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.volume_clear_size    = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.volume_copy_blkio_cgroup_name = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.volume_copy_bps_limit = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.volume_dd_blocksize  = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.volume_driver        = cinder.volume.drivers.quobyte.QuobyteDriver {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] QuobyteHD.volumes_dir          = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.heartbeat_timeout_threshold = 60 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.hostname = devstack {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.kombu_compression = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.kombu_reconnect_splay = 0.0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.processname = cinder-volume {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_bytes = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_quorum_max_memory_length = 0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_stream_fanout = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rabbit_transient_quorum_queue = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.ssl      = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.ssl_ca_file =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.ssl_cert_file =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.ssl_key_file =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.ssl_version =  {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_rabbit.use_queue_manager = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_notifications.driver = [] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_notifications.retry = -1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_notifications.topics = ['notifications'] {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] oslo_messaging_notifications.transport_url = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:32 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] key_manager.backend            = cinder.keymgr.conf_key_mgr.ConfKeyManager {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] key_manager.fixed_key          = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.auth_endpoint         = http://localhost/identity/v3 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.barbican_api_version  = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.barbican_endpoint     = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.barbican_endpoint_type = public {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.barbican_region_name  = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.cafile                = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.certfile              = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.collect_timing        = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.insecure              = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.keyfile               = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.number_of_retries     = 60 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.retry_delay           = 1 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.send_service_user_token = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.split_loggers         = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.timeout               = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.verify_ssl            = True {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican.verify_ssl_path       = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican_service_user.auth_section = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican_service_user.auth_type = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican_service_user.cafile   = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican_service_user.certfile = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican_service_user.collect_timing = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican_service_user.insecure = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican_service_user.keyfile  = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican_service_user.split_loggers = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] barbican_service_user.timeout  = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] vault.approle_role_id          = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] vault.approle_secret_id        = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] vault.kv_mountpoint            = secret {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] vault.kv_path                  = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] vault.kv_version               = 2 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] vault.namespace                = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] vault.root_token_id            = **** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] vault.ssl_ca_crt_file          = None {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] vault.timeout                  = 60.0 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] vault.use_ssl                  = False {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] vault.vault_url                = http://127.0.0.1:8200 {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2824}}
Sep 24 18:07:33 devstack cinder-volume[83960]: DEBUG oslo_service.backend._eventlet.service [None req-8efabcbd-38a3-46a8-9535-f72ab3782e9d None None] ******************************************************************************** {{(pid=83960) log_opt_values /opt/stack/data/venv/lib/python3.10/site-packages/oslo_config/cfg.py:2828}}
Sep 24 18:07:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] nas_secure_file_* settings are true (ownership) and true (permissions). {{(pid=84177) set_nas_security_options /opt/stack/cinder/cinder/volume/drivers/quobyte.py:307}}
Sep 24 18:07:33 devstack cinder-volume[84177]: INFO cinder.volume.drivers.quobyte [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] The NAS file operations will be run as non privileged user in secure mode. Please ensure your libvirtd settings have been configured accordingly (see section 'OpenStack' in the Quobyte Manual.
Sep 24 18:07:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Running cmd (subprocess): mount.quobyte {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:07:33 devstack quobyte-client[84190]: Reading configuration file: /etc/quobyte/client.cfg
Sep 24 18:07:33 devstack quobyte-client[84190]: Invalid parameters found, error: missing mount point.
Sep 24 18:07:33 devstack quobyte-client[84190]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=' to display the log.
Sep 24 18:07:33 devstack quobyte-client[84190]: Failed to parse all commandline parameters, please use -h/--help to see available options.
Sep 24 18:07:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] CMD "mount.quobyte" returned: 1 in 0.567s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:07:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:07:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:07:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:07:33 devstack cinder-volume[84177]: INFO cinder.volume.drivers.quobyte [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Mounting volume: 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b ...
Sep 24 18:07:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Running cmd (subprocess): mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 -c /etc/quobyte/client-cinder.cfg {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:07:34 devstack quobyte-client[84197]: Reading configuration file: /etc/quobyte/client-cinder.cfg
Sep 24 18:07:34 devstack quobyte-client[84197]: Reading configuration file: /etc/quobyte/client.cfg
Sep 24 18:07:34 devstack quobyte-client[84197]: Quobyte logging to journald, you can use 'journalctl QUOBYTE_MOUNTPOINT=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4' to display the log.
Sep 24 18:07:34 devstack quobyte-client[84204]: OptimizeSystemPlacement: Increasing priority of client. If your workload does not perform well, please disable the process placement heuristic (remove --enable_process_placement_heuristic).
Sep 24 18:07:34 devstack quobyte-client[84204]: mount.quobyte 3.25 (4fbbd59204)
Sep 24 18:07:34 devstack quobyte-client[84204]: Client UUID: sE8snMkZ-eR1K-7DLe-2ChP-av8VqEi5oZ2f
Sep 24 18:07:34 devstack quobyte-client[84204]: Registry: osci01.corp.quobyte.com:7861
Sep 24 18:07:34 devstack quobyte-client[84204]: Volume: cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:07:34 devstack quobyte-client[84204]: FUSE version: 316
Sep 24 18:07:34 devstack quobyte-client[84204]: Breakpad initialized (dumping to /home/quobyte/.quobyte/minidumps)
Sep 24 18:07:34 devstack quobyte-client[84204]: Could not set oom_score_adj to default value: Failed to set oom_score_adj -700: 13: Permission denied
Sep 24 18:07:34 devstack quobyte-client[84204]: Setting total object cache size to 3352297472 bytes
Sep 24 18:07:34 devstack quobyte-client[84204]: Using FUSE low-level API
Sep 24 18:07:34 devstack quobyte-client[84204]: Caching of uid/gid to user/group name mappings is enabled
Sep 24 18:07:34 devstack quobyte-client[84204]: Setting up sockets network client, connect timeout (s): 2 linger timeout (s): 1200 request timeout granularity (s): 10
Sep 24 18:07:34 devstack quobyte-client[84204]: Your limit for concurrently opened files ("ulimit -n") is set to 2048. This is too low for the Quobyte client to function properly, and should be set to at least 16384. You can use ulimit, change the system settings or try to use the limit-nofile= option when trying to mount using /etc/fstab.
Sep 24 18:07:34 devstack quobyte-client[84204]: HTTP server started on port 55000
Sep 24 18:07:34 devstack quobyte-client[84204]: Caching mappings from uid/gid to user/group name and group membership temporarily.
Sep 24 18:07:34 devstack quobyte-client[84204]: Mount point /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 established
Sep 24 18:07:34 devstack quobyte-client[84204]: TimeSync is running and remote sync every 60 seconds
Sep 24 18:07:34 devstack quobyte-client[84204]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 24 18:07:34 devstack quobyte-client[84204]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 24 18:07:34 devstack quobyte-client[84204]: Opening volume cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b (1e92ecc5-d598-471f-9681-55a005bf7469)
Sep 24 18:07:34 devstack quobyte-client[84204]: Setting metadata cache size to 500000 based on available system memory of 16 GiB
Sep 24 18:07:34 devstack quobyte-client[84204]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 24 18:07:34 devstack quobyte-client[84204]: Changed metadata cache configuration for volume 1e92ecc5-d598-471f-9681-55a005bf7469 to cache_ttl_ms: 0 negative_cache_ttl_ms: 0 enable_write_back_cache: false
Sep 24 18:07:34 devstack quobyte-client[84204]: Failed to invalidate inode: 38: Function not implemented
Sep 24 18:07:34 devstack quobyte-client[84204]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 24 18:07:34 devstack quobyte-client[84204]: Automatic minidump upload enabled by global system configuration
Sep 24 18:07:34 devstack quobyte-client[84204]: Announcing HTTP status server address 172.24.4.1
Sep 24 18:07:34 devstack quobyte-client[84204]: Registered as service (uuid sE8snMkZ-eR1K-7DLe-2ChP-av8VqEi5oZ2f)
Sep 24 18:07:34 devstack quobyte-client[84204]: Quobyte Client running as pid 84204
Sep 24 18:07:34 devstack quobyte-client[84204]: FUSE announces support for async read, posix locks, atomic O_TRUNC, export support, don't mask, splice write, splice move, splice read, flock, directory ioctl, auto invalidate data, readdir plus, readdir plus auto, async direct IO, writeback cache, no open support, parallel dirops, posix acl, handle killpriv, handle killpriv2
Sep 24 18:07:34 devstack quobyte-client[84204]: FUSE capabilities enabled: async read, posix locks, atomic O_TRUNC, don't mask, flock, readdir plus, async direct IO, posix acl
Sep 24 18:07:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] CMD "mount.quobyte --disable-xattrs 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 -c /etc/quobyte/client-cinder.cfg" returned: 0 in 1.006s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:07:34 devstack cinder-volume[84177]: INFO cinder.volume.drivers.quobyte [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Mounting volume: 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b succeeded
Sep 24 18:07:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:07:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 1.116s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:07:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:07:34 devstack quobyte-client[84204]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.148s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:07:35 devstack cinder-volume[84177]: INFO cinder.volume.driver [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Driver hasn't implemented _init_vendor_properties()
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG cinder.volume.driver [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Initialized capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914306640625, 'free_capacity_gb': 924.914306640625, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84177) init_capabilities /opt/stack/cinder/cinder/volume/driver.py:860}}
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG oslo_db.sqlalchemy.engines [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=84177) _check_effective_sql_mode /opt/stack/data/venv/lib/python3.10/site-packages/oslo_db/sqlalchemy/engines.py:397}}
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writer thread running {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:102}}
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG cinder.db.sqlalchemy.api [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Building query based on filter {{(pid=84177) _process_snaps_filters /opt/stack/cinder/cinder/db/sqlalchemy/api.py:3917}}
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Configuration image_conversion_dir is None or the path doesn't exist. {{(pid=84177) cleanup_temporary_file /opt/stack/cinder/cinder/image/image_utils.py:1266}}
Sep 24 18:07:35 devstack cinder-volume[84177]: INFO cinder.keymgr.migration [None req-e63256bd-c405-4ebb-8506-9d7c0e106a0a None None] Not migrating encryption keys because the ConfKeyManager is still in use.
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.080s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:07:35 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:07:35 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Driver initialization completed successfully.
Sep 24 18:07:35 devstack cinder-volume[84177]: INFO cinder.manager [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Initiating service 3 cleanup
Sep 24 18:07:36 devstack cinder-volume[84177]: INFO cinder.manager [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Service 3 cleanup completed.
Sep 24 18:07:36 devstack cinder-volume[84177]: DEBUG cinder.service [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Creating RPC server for service cinder-volume {{(pid=84177) start /opt/stack/cinder/cinder/service.py:239}}
Sep 24 18:07:36 devstack cinder-volume[84177]: DEBUG cinder.service [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Pinning object versions for RPC server serializer to 1.39 {{(pid=84177) start /opt/stack/cinder/cinder/service.py:245}}
Sep 24 18:07:36 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Initializing RPC dependent components of volume driver QuobyteDriver (1.1.13)
Sep 24 18:07:36 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:07:36 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:07:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:07:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:07:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:07:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:07:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:07:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:07:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.132s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:07:36 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-0b90c9d5-4d6f-4b33-a43d-aeb2b8e09b53 None None] Driver post RPC initialization completed successfully.
Sep 24 18:07:37 devstack quobyte-client[84204]: Resolving 'registry:' with default 10.10.41.181:7861
Sep 24 18:07:41 devstack cinder-volume[83960]: DEBUG dbcounter [-] [83960] Writing DB stats cinder:SELECT=6,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=83960) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:07:46 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=9,cinder:INSERT=1,cinder:UPDATE=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:07:46 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:08:37 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:08:37 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:08:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Flow 'volume_create_manager' (ceca5d6f-64c6-426a-8587-2423f5f1ca5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:08:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6e9b1e-83a5-420f-beeb-f3ce9538d735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:08:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f6e9b1e-83a5-420f-beeb-f3ce9538d735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1136612933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9948ad-f397-4c39-8e04-05f597880144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1884a7535d5c49f09c48ebb7d546fbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:08:38Z,use_quota=True,user_id='bf13b5910aa745f9a2dec6eb09dc142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:08:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9848f50c-0bff-48fa-a082-9a6b47e31115) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:08:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9848f50c-0bff-48fa-a082-9a6b47e31115) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:08:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a58ab2d-4357-482b-95de-31cd0c34954e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:08:38 devstack cinder-volume[84177]: DEBUG cinder.image.glance [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Creating Keystone auth plugin from conf {{(pid=84177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 18:08:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8a58ab2d-4357-482b-95de-31cd0c34954e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '9b9948ad-f397-4c39-8e04-05f597880144', 'volume_name': 'volume-9b9948ad-f397-4c39-8e04-05f597880144', 'volume_size': 1, 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31cf1489d51f4b27a6681fc59f94a26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'created_at': datetime.datetime(2025, 9, 24, 16, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 1, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f30344038e0>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:08:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f480fc-b900-417e-b43d-8207fdf5a9bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:08:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b6f480fc-b900-417e-b43d-8207fdf5a9bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:08:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49aae978-e7d5-4a96-9c06-5d607b9a05bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:08:38 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Volume 9b9948ad-f397-4c39-8e04-05f597880144: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-9b9948ad-f397-4c39-8e04-05f597880144', 'volume_size': 1, 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31cf1489d51f4b27a6681fc59f94a26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'created_at': datetime.datetime(2025, 9, 24, 16, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 1, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f30344038e0>}
Sep 24 18:08:38 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Cloning 9b9948ad-f397-4c39-8e04-05f597880144 from image f48d314e-3a4b-4449-a990-1eaf5b733ce4  at location (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]). {{(pid=84177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 18:08:42 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_62b13rw9devstack@QuobyteHD, size 20.69 MB, duration 3.82 sec {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 18:08:42 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Image download 20.69 MB at 5.42 MB/s
Sep 24 18:08:42 devstack cinder-volume[84177]: INFO oslo.privsep.daemon [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Running privsep helper: ['sudo', 'cinder-rootwrap', '/etc/cinder/rootwrap.conf', 'privsep-helper', '--config-file', '/etc/cinder/cinder.conf', '--privsep_context', 'cinder.privsep.sys_admin_pctxt', '--privsep_sock_path', '/tmp/tmpkjraxrw8/privsep.sock']
Sep 24 18:08:42 devstack sudo[84471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf privsep-helper --config-file /etc/cinder/cinder.conf --privsep_context cinder.privsep.sys_admin_pctxt --privsep_sock_path /tmp/tmpkjraxrw8/privsep.sock
Sep 24 18:08:42 devstack sudo[84471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:08:47 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:08:48 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:08:48 devstack sudo[84471]: pam_unix(sudo:session): session closed for user root
Sep 24 18:08:48 devstack cinder-volume[84177]: INFO oslo.privsep.daemon [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Spawned new privsep daemon via rootwrap
Sep 24 18:08:48 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Accepted privsep connection to /tmp/tmpkjraxrw8/privsep.sock {{(pid=84177) __init__ /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:377}}
Sep 24 18:08:48 devstack cinder-volume[84177]: INFO oslo.privsep.daemon [-] privsep daemon starting
Sep 24 18:08:48 devstack cinder-volume[84177]: INFO oslo.privsep.daemon [-] privsep process running with uid/gid: 0/0
Sep 24 18:08:48 devstack cinder-volume[84177]: INFO oslo.privsep.daemon [-] privsep process running with capabilities (eff/prm/inh): CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/CAP_CHOWN|CAP_DAC_OVERRIDE|CAP_DAC_READ_SEARCH|CAP_FOWNER|CAP_NET_ADMIN|CAP_SYS_ADMIN/none
Sep 24 18:08:48 devstack cinder-volume[84177]: INFO oslo.privsep.daemon [-] privsep daemon running as pid 84475
Sep 24 18:08:48 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[04e517ad-cf95-484d-981f-11a3ecaadc90]: (2,) {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:08:48 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[dc588f46-e8aa-4653-bb8d-01f05a333997]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:08:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_62b13rw9devstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:08:49 devstack sudo[84477]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_62b13rw9devstack@QuobyteHD
Sep 24 18:08:49 devstack sudo[84477]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:08:51 devstack sudo[84477]: pam_unix(sudo:session): session closed for user root
Sep 24 18:08:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_62b13rw9devstack@QuobyteHD" returned: 0 in 3.209s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:08:51 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Temporary image f48d314e-3a4b-4449-a990-1eaf5b733ce4 is fetched for user bf13b5910aa745f9a2dec6eb09dc142a. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 18:08:52 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d244c16-6c3c-40b2-95ba-6e731650e4e4]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:08:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_62b13rw9devstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:08:52 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:08:52 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Flow 'volume_create_manager' (aab060a2-47df-41b0-8b4b-553e778186ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd35265b-5d85-4320-bfac-dc59bfdd45e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:08:53 devstack sudo[84487]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_62b13rw9devstack@QuobyteHD
Sep 24 18:08:53 devstack sudo[84487]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cd35265b-5d85-4320-bfac-dc59bfdd45e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-600803887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e571fd-6d26-4fbb-9459-b31a304a6925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad66e0c5c944ceebad0a7388e453395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:08:52Z,use_quota=True,user_id='bca4a5536f0140e999d3334f0f292746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59d7720-e5f1-4003-b3a2-26ea88674cc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f59d7720-e5f1-4003-b3a2-26ea88674cc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16e78e0-2a42-4d21-986a-ccf0644c4cb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b16e78e0-2a42-4d21-986a-ccf0644c4cb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14e571fd-6d26-4fbb-9459-b31a304a6925', 'volume_name': 'volume-14e571fd-6d26-4fbb-9459-b31a304a6925', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a872fda-11b8-4343-a39d-0f964068f0fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2a872fda-11b8-4343-a39d-0f964068f0fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a387aff9-158b-4c2e-8b2b-9f33df2d6c26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:08:53 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Volume 14e571fd-6d26-4fbb-9459-b31a304a6925: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14e571fd-6d26-4fbb-9459-b31a304a6925', 'volume_size': 1}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:08:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAssistedSnapshotsTest-volume-600803887',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14e571fd-6d26-4fbb-9459-b31a304a6925,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='aad66e0c5c944ceebad0a7388e453395',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:08:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:08:52Z,use_quota=True,user_id='bca4a5536f0140e999d3334f0f292746',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Creating volume 14e571fd-6d26-4fbb-9459-b31a304a6925 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:08:53 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:08:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14e571fd-6d26-4fbb-9459-b31a304a6925 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:08:53 devstack quobyte-client[84204]: System call of process 84489 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:08:53 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=2, name=volume-14e571fd-6d26-4fbb-9459-b31a304a6925, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:08:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14e571fd-6d26-4fbb-9459-b31a304a6925 1073741824" returned: 0 in 0.937s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:08:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14e571fd-6d26-4fbb-9459-b31a304a6925 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:08:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14e571fd-6d26-4fbb-9459-b31a304a6925" returned: 0 in 0.160s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:08:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] <== create_volume: return (1176ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:08:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.189s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:08:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a387aff9-158b-4c2e-8b2b-9f33df2d6c26) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14e571fd-6d26-4fbb-9459-b31a304a6925', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:08:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef658383-f8a5-4b20-a968-f8dabbd6947e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:08:54 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Volume volume-14e571fd-6d26-4fbb-9459-b31a304a6925 (14e571fd-6d26-4fbb-9459-b31a304a6925): created successfully
Sep 24 18:08:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ef658383-f8a5-4b20-a968-f8dabbd6947e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:08:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Flow 'volume_create_manager' (aab060a2-47df-41b0-8b4b-553e778186ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:08:54 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-51cb00c5-b519-4ff3-a8f2-7dd767cb6334 tempest-VolumesAssistedSnapshotsTest-170776783 None] Created volume successfully.
Sep 24 18:08:55 devstack sudo[84487]: pam_unix(sudo:session): session closed for user root
Sep 24 18:08:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_62b13rw9devstack@QuobyteHD" returned: 0 in 3.274s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:08:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:08:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:08:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:08:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1136612933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9b9948ad-f397-4c39-8e04-05f597880144,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1884a7535d5c49f09c48ebb7d546fbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:08:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:08:38Z,use_quota=True,user_id='bf13b5910aa745f9a2dec6eb09dc142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:08:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Creating volume 9b9948ad-f397-4c39-8e04-05f597880144 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:08:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:08:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:08:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:08:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:08:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:08:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:08:55 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:08:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:08:56 devstack quobyte-client[84204]: System call of process 84814 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:08:56 devstack quobyte-client[84204]: System call of process 84814 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:08:56 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=3, name=volume-9b9948ad-f397-4c39-8e04-05f597880144, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:08:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 1073741824" returned: 0 in 0.522s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:08:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:08:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144" returned: 0 in 0.111s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:08:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] <== create_volume: return (724ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:08:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.751s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:08:56 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Attempting download of f48d314e-3a4b-4449-a990-1eaf5b733ce4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}])) to volume 9b9948ad-f397-4c39-8e04-05f597880144. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1184}}
Sep 24 18:08:57 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e018099-6904-4dc0-bc20-0900e916f296]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:08:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_zxeaydqa {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:08:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_zxeaydqa" returned: 0 in 0.418s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:08:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_zxeaydqa {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:08:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_zxeaydqa" returned: 1 in 0.567s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:08:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_zxeaydqa' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:08:58 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0242980-119a-4265-85b3-30fe8c5f74ff]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:08:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_62b13rw9devstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:08:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_62b13rw9devstack@QuobyteHD" returned: 0 in 0.393s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:08:58 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] f48d314e-3a4b-4449-a990-1eaf5b733ce4 was qcow2, converting to raw {{(pid=84177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 18:08:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_62b13rw9devstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:08:58 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=3, name=volume-9b9948ad-f397-4c39-8e04-05f597880144, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:08:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_62b13rw9devstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144" returned: 0 in 1.223s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:08:59 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_62b13rw9devstack@QuobyteHD, size 112.00 MB, duration 1.28 sec, destination /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:08:59 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Converted 112.00 MB image at 87.78 MB/s
Sep 24 18:08:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:08:59 devstack quobyte-client[84204]: System call of process 84838 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 1G" returned: 0 in 0.229s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:00 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[db86bedb-b771-45f9-b422-b3aeee398172]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:09:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:00 devstack quobyte-client[84204]: System call of process 84841 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144" returned: 0 in 0.749s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144" returned: 1 in 0.572s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:09:01 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Downloaded image f48d314e-3a4b-4449-a990-1eaf5b733ce4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}])) to volume 9b9948ad-f397-4c39-8e04-05f597880144 successfully. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1229}}
Sep 24 18:09:01 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Temporary image f48d314e-3a4b-4449-a990-1eaf5b733ce4 for user bf13b5910aa745f9a2dec6eb09dc142a is deleted. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 18:09:01 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Marking volume 9b9948ad-f397-4c39-8e04-05f597880144 as bootable. {{(pid=84177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1133}}
Sep 24 18:09:01 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Copying metadata from image f48d314e-3a4b-4449-a990-1eaf5b733ce4 to 9b9948ad-f397-4c39-8e04-05f597880144. {{(pid=84177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 18:09:01 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Creating volume glance metadata for volume 9b9948ad-f397-4c39-8e04-05f597880144 backed by image f48d314e-3a4b-4449-a990-1eaf5b733ce4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 18:09:02 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (49aae978-e7d5-4a96-9c06-5d607b9a05bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9b9948ad-f397-4c39-8e04-05f597880144', 'volume_size': 1, 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31cf1489d51f4b27a6681fc59f94a26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'created_at': datetime.datetime(2025, 9, 24, 16, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 1, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f30344038e0>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:02 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1029be2-38b7-4efd-9cb3-562a0a4ef2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:02 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Volume volume-9b9948ad-f397-4c39-8e04-05f597880144 (9b9948ad-f397-4c39-8e04-05f597880144): created successfully
Sep 24 18:09:02 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b1029be2-38b7-4efd-9cb3-562a0a4ef2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:02 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Flow 'volume_create_manager' (ceca5d6f-64c6-426a-8587-2423f5f1ca5e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:09:02 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b56e67e8-fa6f-4900-8fb0-ffdb0dff8357 tempest-TaggedBootDevicesTest-1636802067 None] Created volume successfully.
Sep 24 18:09:04 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Flow 'volume_create_manager' (68d06330-6a8f-46f8-a874-6dc8fa501c6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb5b662-2a81-423d-86f4-6ed3c38d5128) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ddb5b662-2a81-423d-86f4-6ed3c38d5128) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-530599628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2c0856-d004-4d7b-82be-c1b55ee592ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1884a7535d5c49f09c48ebb7d546fbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:09:04Z,use_quota=True,user_id='bf13b5910aa745f9a2dec6eb09dc142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ca7659-4b83-4e68-9a56-923a15f35f85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (74ca7659-4b83-4e68-9a56-923a15f35f85) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420195aa-a66c-42eb-9488-00c419b109ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (420195aa-a66c-42eb-9488-00c419b109ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'af2c0856-d004-4d7b-82be-c1b55ee592ef', 'volume_name': 'volume-af2c0856-d004-4d7b-82be-c1b55ee592ef', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301ab27f-f6bb-42f1-9bb6-26f03a9aa5ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (301ab27f-f6bb-42f1-9bb6-26f03a9aa5ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c4b866-6089-4c17-9492-9dc8fea6419d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:04 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Volume af2c0856-d004-4d7b-82be-c1b55ee592ef: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-af2c0856-d004-4d7b-82be-c1b55ee592ef', 'volume_size': 1}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:09:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-530599628',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=af2c0856-d004-4d7b-82be-c1b55ee592ef,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1884a7535d5c49f09c48ebb7d546fbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:09:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:09:04Z,use_quota=True,user_id='bf13b5910aa745f9a2dec6eb09dc142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Creating volume af2c0856-d004-4d7b-82be-c1b55ee592ef {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:09:04 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:09:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-af2c0856-d004-4d7b-82be-c1b55ee592ef 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:04 devstack quobyte-client[84204]: System call of process 84866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:04 devstack quobyte-client[84204]: System call of process 84866 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:04 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=4, name=volume-af2c0856-d004-4d7b-82be-c1b55ee592ef, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:09:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-af2c0856-d004-4d7b-82be-c1b55ee592ef 1073741824" returned: 0 in 0.621s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-af2c0856-d004-4d7b-82be-c1b55ee592ef {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-af2c0856-d004-4d7b-82be-c1b55ee592ef" returned: 0 in 0.112s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] <== create_volume: return (887ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:09:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.904s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:09:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (48c4b866-6089-4c17-9492-9dc8fea6419d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-af2c0856-d004-4d7b-82be-c1b55ee592ef', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f2b184-8ebe-4dae-bc09-49bb410c3987) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:05 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Volume volume-af2c0856-d004-4d7b-82be-c1b55ee592ef (af2c0856-d004-4d7b-82be-c1b55ee592ef): created successfully
Sep 24 18:09:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (31f2b184-8ebe-4dae-bc09-49bb410c3987) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Flow 'volume_create_manager' (68d06330-6a8f-46f8-a874-6dc8fa501c6d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:09:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d51d0e2a-c2fb-444c-ac0e-e1fbf016046f tempest-TaggedBootDevicesTest-1636802067 None] Created volume successfully.
Sep 24 18:09:07 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Flow 'volume_create_manager' (74123b42-5769-40c2-b123-6ef6dce73cf1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12cb8dc-d285-452e-8027-ea03a05b1ea2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c12cb8dc-d285-452e-8027-ea03a05b1ea2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1305573725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa99ddd-3656-43fe-93fc-e3628a83e852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1884a7535d5c49f09c48ebb7d546fbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:09:07Z,use_quota=True,user_id='bf13b5910aa745f9a2dec6eb09dc142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4a9005-fcc2-4ec6-b171-c6e239e2827b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0d4a9005-fcc2-4ec6-b171-c6e239e2827b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65a1269-9cdc-489a-b310-4fc1c889ed21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c65a1269-9cdc-489a-b310-4fc1c889ed21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8aa99ddd-3656-43fe-93fc-e3628a83e852', 'volume_name': 'volume-8aa99ddd-3656-43fe-93fc-e3628a83e852', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16977fa-21d6-4b30-9709-9eee7f61dcf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d16977fa-21d6-4b30-9709-9eee7f61dcf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53abeed4-e184-4151-bd7a-94d0c198957f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:07 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Volume 8aa99ddd-3656-43fe-93fc-e3628a83e852: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8aa99ddd-3656-43fe-93fc-e3628a83e852', 'volume_size': 1}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:09:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedBootDevicesTest-volume-1305573725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8aa99ddd-3656-43fe-93fc-e3628a83e852,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1884a7535d5c49f09c48ebb7d546fbcc',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:09:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:09:07Z,use_quota=True,user_id='bf13b5910aa745f9a2dec6eb09dc142a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Creating volume 8aa99ddd-3656-43fe-93fc-e3628a83e852 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.059s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:09:07 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:09:07 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:09:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8aa99ddd-3656-43fe-93fc-e3628a83e852 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:08 devstack quobyte-client[84204]: System call of process 84911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:08 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=5, name=volume-8aa99ddd-3656-43fe-93fc-e3628a83e852, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:09:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8aa99ddd-3656-43fe-93fc-e3628a83e852 1073741824" returned: 0 in 0.774s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8aa99ddd-3656-43fe-93fc-e3628a83e852 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8aa99ddd-3656-43fe-93fc-e3628a83e852" returned: 0 in 0.134s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] <== create_volume: return (1048ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:09:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.069s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:09:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (53abeed4-e184-4151-bd7a-94d0c198957f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8aa99ddd-3656-43fe-93fc-e3628a83e852', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2827d612-0378-4891-b107-b44fa874e5d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:09 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Volume volume-8aa99ddd-3656-43fe-93fc-e3628a83e852 (8aa99ddd-3656-43fe-93fc-e3628a83e852): created successfully
Sep 24 18:09:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2827d612-0378-4891-b107-b44fa874e5d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Flow 'volume_create_manager' (74123b42-5769-40c2-b123-6ef6dce73cf1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:09:09 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-baf2ee2f-9d9c-444c-8555-3c0746c4fc5b tempest-TaggedBootDevicesTest-1636802067 None] Created volume successfully.
Sep 24 18:09:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:09:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:09:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:09:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:09:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:09:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:09:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.222s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:09:19 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=16,cinder:INSERT=13,cinder:UPDATE=11 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:09:19 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:DELETE=4 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:09:45 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:09:45 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:09:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Flow 'volume_create_manager' (118b467f-c1e0-4ab4-827d-2fff1a474eac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:09:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884b2745-d3e8-47c0-b7e4-c29e602b1d33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (884b2745-d3e8-47c0-b7e4-c29e602b1d33) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-543377615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7445016a-7dff-4ab1-8288-cb3302e93986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf92ab7ed544a81ac1ded23332f8703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:09:44Z,use_quota=True,user_id='247f575de19b4fbfbaa51ddb1077de36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f4bb25-4503-4c94-8010-fad90e4d25df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (75f4bb25-4503-4c94-8010-fad90e4d25df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2931137a-2f61-4cc6-9c45-cc62d866344b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2931137a-2f61-4cc6-9c45-cc62d866344b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7445016a-7dff-4ab1-8288-cb3302e93986', 'volume_name': 'volume-7445016a-7dff-4ab1-8288-cb3302e93986', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a615f7d-9491-461c-8eda-2765cb38e746) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3a615f7d-9491-461c-8eda-2765cb38e746) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ecb7d8-5ba3-441b-9ac9-0bcf8264027e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:46 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Volume 7445016a-7dff-4ab1-8288-cb3302e93986: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7445016a-7dff-4ab1-8288-cb3302e93986', 'volume_size': 1}
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:09:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesAdminNegativeTest-volume-543377615',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7445016a-7dff-4ab1-8288-cb3302e93986,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='baf92ab7ed544a81ac1ded23332f8703',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:09:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:09:44Z,use_quota=True,user_id='247f575de19b4fbfbaa51ddb1077de36',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Creating volume 7445016a-7dff-4ab1-8288-cb3302e93986 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.082s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:09:46 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:09:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7445016a-7dff-4ab1-8288-cb3302e93986 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:46 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=6, name=volume-7445016a-7dff-4ab1-8288-cb3302e93986, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:09:47 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:09:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7445016a-7dff-4ab1-8288-cb3302e93986 1073741824" returned: 0 in 1.446s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7445016a-7dff-4ab1-8288-cb3302e93986 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7445016a-7dff-4ab1-8288-cb3302e93986" returned: 0 in 1.301s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] <== create_volume: return (2993ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:09:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 3.038s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:09:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e3ecb7d8-5ba3-441b-9ac9-0bcf8264027e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7445016a-7dff-4ab1-8288-cb3302e93986', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c64fb7-7529-4751-9984-2878a14c73d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:09:49 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Volume volume-7445016a-7dff-4ab1-8288-cb3302e93986 (7445016a-7dff-4ab1-8288-cb3302e93986): created successfully
Sep 24 18:09:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (17c64fb7-7529-4751-9984-2878a14c73d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:09:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Flow 'volume_create_manager' (118b467f-c1e0-4ab4-827d-2fff1a474eac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:09:49 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-178707ae-08c3-41a9-ab0b-afbdb90a1a23 tempest-VolumesAdminNegativeTest-1312003342 None] Created volume successfully.
Sep 24 18:09:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Acquiring lock "cinder-7445016a-7dff-4ab1-8288-cb3302e93986-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:09:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Lock "cinder-7445016a-7dff-4ab1-8288-cb3302e93986-delete_volume" acquired by "delete_volume" :: waited 0.318s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:09:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:09:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Acquiring lock "cinder-quobyte-7445016a-7dff-4ab1-8288-cb3302e93986" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:09:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Lock "cinder-quobyte-7445016a-7dff-4ab1-8288-cb3302e93986" acquired by "delete_volume" :: waited 0.050s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:09:53 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[21759431-b2fe-438c-a29a-44bd3ce9b13f]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:09:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7445016a-7dff-4ab1-8288-cb3302e93986 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:56 devstack quobyte-client[84204]: System call of process 85100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:56 devstack quobyte-client[84204]: System call of process 85100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:56 devstack quobyte-client[84204]: System call of process 85100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:09:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7445016a-7dff-4ab1-8288-cb3302e93986" returned: 0 in 3.611s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7445016a-7dff-4ab1-8288-cb3302e93986 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:09:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7445016a-7dff-4ab1-8288-cb3302e93986" returned: 0 in 0.583s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:09:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Lock "cinder-quobyte-7445016a-7dff-4ab1-8288-cb3302e93986" released by "delete_volume" :: held 5.528s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:00 devstack cinder-volume[84177]: WARNING cinder.quota [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Deprecated: Default quota for resource: volumes_QuobyteHD is set by the default quota flag: quota_volumes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:10:00 devstack cinder-volume[84177]: WARNING cinder.quota [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Deprecated: Default quota for resource: gigabytes_QuobyteHD is set by the default quota flag: quota_gigabytes_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:10:01 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Created reservations ['212d44d0-0189-4ad2-be03-ecf885dcf92d', 'd67c0d74-f28d-4f60-8da3-37ee09f51a74', '8e472a60-f371-4606-8043-e6ee7eada546', '9b5274dd-a44e-42aa-86df-2e22e3529662'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:10:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.034s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:02 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:10:02 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:10:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.060s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.437s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:03 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:10:03 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Deleted volume successfully.
Sep 24 18:10:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-91ecc5be-6a3c-4482-8f7f-b1a2bf5b02da tempest-VolumesAdminNegativeTest-1312003342 None] Lock "cinder-7445016a-7dff-4ab1-8288-cb3302e93986-delete_volume" released by "delete_volume" :: held 13.351s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:10:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-31f5eed1-edf9-498d-b779-556d2ef84b74 tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-31f5eed1-edf9-498d-b779-556d2ef84b74 tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:06 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f8bf8646-7cd5-45de-b4ea-112b557f4984]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:10:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-31f5eed1-edf9-498d-b779-556d2ef84b74 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-31f5eed1-edf9-498d-b779-556d2ef84b74 tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144" returned: 0 in 2.606s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-31f5eed1-edf9-498d-b779-556d2ef84b74 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:11 devstack quobyte-client[84204]: System call of process 85181 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:11 devstack quobyte-client[84204]: System call of process 85181 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:10:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:10:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:10:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-31f5eed1-edf9-498d-b779-556d2ef84b74 tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144" returned: 1 in 2.571s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-31f5eed1-edf9-498d-b779-556d2ef84b74 tempest-TaggedBootDevicesTest-1636802067 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:10:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-31f5eed1-edf9-498d-b779-556d2ef84b74 tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 5.860s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 1.582s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:13 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:10:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-31f5eed1-edf9-498d-b779-556d2ef84b74 tempest-TaggedBootDevicesTest-1636802067 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-9b9948ad-f397-4c39-8e04-05f597880144', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '3a77ef89-6d46-45aa-b8a0-46ece13e482d', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:10:13 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-31f5eed1-edf9-498d-b779-556d2ef84b74 tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:14 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-31f5eed1-edf9-498d-b779-556d2ef84b74 tempest-TaggedBootDevicesTest-1636802067 None] attachment_update completed successfully.
Sep 24 18:10:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-67645978-384d-4100-89b1-0c5fe3ad25cf tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-67645978-384d-4100-89b1-0c5fe3ad25cf tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:19 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b398113b-9a1a-4a82-932b-49a1f70db600]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:10:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-67645978-384d-4100-89b1-0c5fe3ad25cf tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-af2c0856-d004-4d7b-82be-c1b55ee592ef {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:20 devstack quobyte-client[84204]: System call of process 85256 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:20 devstack quobyte-client[84204]: System call of process 85256 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:20 devstack quobyte-client[84204]: System call of process 85256 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-67645978-384d-4100-89b1-0c5fe3ad25cf tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-af2c0856-d004-4d7b-82be-c1b55ee592ef" returned: 0 in 1.255s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-67645978-384d-4100-89b1-0c5fe3ad25cf tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.735s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-67645978-384d-4100-89b1-0c5fe3ad25cf tempest-TaggedBootDevicesTest-1636802067 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-af2c0856-d004-4d7b-82be-c1b55ee592ef', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e62073b7-437a-4043-8ace-c758385bd11c', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:10:21 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-67645978-384d-4100-89b1-0c5fe3ad25cf tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:21 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-67645978-384d-4100-89b1-0c5fe3ad25cf tempest-TaggedBootDevicesTest-1636802067 None] attachment_update completed successfully.
Sep 24 18:10:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-db14d19f-9368-4d35-881a-652a4a34f762 tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:10:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-db14d19f-9368-4d35-881a-652a4a34f762 tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:10:28 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[08bca723-0e49-4bbb-8798-fc106af2b2cd]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:10:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-db14d19f-9368-4d35-881a-652a4a34f762 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8aa99ddd-3656-43fe-93fc-e3628a83e852 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:10:30 devstack quobyte-client[84204]: System call of process 85318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:30 devstack quobyte-client[84204]: System call of process 85318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:30 devstack quobyte-client[84204]: System call of process 85318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:30 devstack quobyte-client[84204]: System call of process 85318 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:10:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-db14d19f-9368-4d35-881a-652a4a34f762 tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8aa99ddd-3656-43fe-93fc-e3628a83e852" returned: 0 in 1.365s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:10:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-db14d19f-9368-4d35-881a-652a4a34f762 tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.525s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:10:30 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=23,cinder:SELECT=18,cinder:DELETE=1,cinder:INSERT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:10:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-db14d19f-9368-4d35-881a-652a4a34f762 tempest-TaggedBootDevicesTest-1636802067 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-8aa99ddd-3656-43fe-93fc-e3628a83e852', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '7c7a7811-5ec4-4aef-92c6-bc9e34cd4110', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:10:30 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-db14d19f-9368-4d35-881a-652a4a34f762 tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:10:31 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-67259b06-ba75-4ec7-ad86-eb9f9d0cb090 req-db14d19f-9368-4d35-881a-652a4a34f762 tempest-TaggedBootDevicesTest-1636802067 None] attachment_update completed successfully.
Sep 24 18:10:41 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:10:41 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=7,cinder:SELECT=25,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:11:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-6630477e-9459-41ea-bef1-962c2db71118 req-f950f3d3-83ac-4c1b-a038-013130e6d8d1 tempest-VolumesAssistedSnapshotsTest-170776783 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-6630477e-9459-41ea-bef1-962c2db71118 req-f950f3d3-83ac-4c1b-a038-013130e6d8d1 tempest-VolumesAssistedSnapshotsTest-170776783 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:08 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9524e411-faf8-4d99-9533-def04934b052]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-6630477e-9459-41ea-bef1-962c2db71118 req-f950f3d3-83ac-4c1b-a038-013130e6d8d1 tempest-VolumesAssistedSnapshotsTest-170776783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14e571fd-6d26-4fbb-9459-b31a304a6925 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:11:11 devstack quobyte-client[84204]: System call of process 86168 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:11 devstack quobyte-client[84204]: System call of process 86168 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.094s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:11:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:11:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.164s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-6630477e-9459-41ea-bef1-962c2db71118 req-f950f3d3-83ac-4c1b-a038-013130e6d8d1 tempest-VolumesAssistedSnapshotsTest-170776783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14e571fd-6d26-4fbb-9459-b31a304a6925" returned: 0 in 3.632s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-6630477e-9459-41ea-bef1-962c2db71118 req-f950f3d3-83ac-4c1b-a038-013130e6d8d1 tempest-VolumesAssistedSnapshotsTest-170776783 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 3.879s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.872s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:13 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:11:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-6630477e-9459-41ea-bef1-962c2db71118 req-f950f3d3-83ac-4c1b-a038-013130e6d8d1 tempest-VolumesAssistedSnapshotsTest-170776783 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-14e571fd-6d26-4fbb-9459-b31a304a6925', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'f2231b8f-d41f-452f-b210-b3831a29c3b8', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:11:13 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-6630477e-9459-41ea-bef1-962c2db71118 req-f950f3d3-83ac-4c1b-a038-013130e6d8d1 tempest-VolumesAssistedSnapshotsTest-170776783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:14 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-6630477e-9459-41ea-bef1-962c2db71118 req-f950f3d3-83ac-4c1b-a038-013130e6d8d1 tempest-VolumesAssistedSnapshotsTest-170776783 None] attachment_update completed successfully.
Sep 24 18:11:24 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=3,cinder:UPDATE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:11:24 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:11:46 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:11:48 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-8f1db65f-81cb-4a5f-b2dd-c0a6e888cef4 req-f3554491-6ce3-43de-a777-03718e7fd413 tempest-VolumesAssistedSnapshotsTest-170776783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:48 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-8f1db65f-81cb-4a5f-b2dd-c0a6e888cef4 req-f3554491-6ce3-43de-a777-03718e7fd413 tempest-VolumesAssistedSnapshotsTest-170776783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:48 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-8f1db65f-81cb-4a5f-b2dd-c0a6e888cef4 req-f3554491-6ce3-43de-a777-03718e7fd413 tempest-VolumesAssistedSnapshotsTest-170776783 None] Terminate volume connection completed successfully.
Sep 24 18:11:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-8f1db65f-81cb-4a5f-b2dd-c0a6e888cef4 req-f3554491-6ce3-43de-a777-03718e7fd413 tempest-VolumesAssistedSnapshotsTest-170776783 None] Deleting attachment f2231b8f-d41f-452f-b210-b3831a29c3b8. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:11:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Acquiring lock "cinder-14e571fd-6d26-4fbb-9459-b31a304a6925-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Lock "cinder-14e571fd-6d26-4fbb-9459-b31a304a6925-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:51 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:11:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Acquiring lock "cinder-quobyte-14e571fd-6d26-4fbb-9459-b31a304a6925" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:11:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Lock "cinder-quobyte-14e571fd-6d26-4fbb-9459-b31a304a6925" acquired by "delete_volume" :: waited 0.055s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:11:51 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d96cb422-257f-4274-bacd-caa1740a95ac]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:11:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14e571fd-6d26-4fbb-9459-b31a304a6925 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:52 devstack quobyte-client[84204]: System call of process 86352 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:11:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14e571fd-6d26-4fbb-9459-b31a304a6925" returned: 0 in 1.127s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14e571fd-6d26-4fbb-9459-b31a304a6925 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14e571fd-6d26-4fbb-9459-b31a304a6925" returned: 0 in 0.239s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Lock "cinder-quobyte-14e571fd-6d26-4fbb-9459-b31a304a6925" released by "delete_volume" :: held 1.758s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:11:53 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Created reservations ['7ab626df-bd57-4171-b80f-bbc173451586', 'aa027de9-7ecf-4c21-9644-4503ab79baa0', '727e31c4-e055-4df2-b6e8-cc5b348fa030', '1b69faf6-477d-4556-ad64-3cbde47849d8'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:11:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:11:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:11:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:11:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:11:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:11:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:11:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.112s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:11:54 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:11:54 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Deleted volume successfully.
Sep 24 18:11:54 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7eabdb4c-b52b-4368-a81b-8fefc5f63569 tempest-VolumesAssistedSnapshotsTest-170776783 None] Lock "cinder-14e571fd-6d26-4fbb-9459-b31a304a6925-delete_volume" released by "delete_volume" :: held 2.979s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:12:03 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=9,cinder:UPDATE=7 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:12:04 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=3,cinder:UPDATE=9,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:12:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:12:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:12:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:12:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.272s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:12:13 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:13 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:12:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Flow 'volume_create_manager' (15a9df5b-bdca-4a80-b5ae-803b83d4b3d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:12:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb83b03b-ea4c-4a3f-99f6-75a83cc7fad6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cb83b03b-ea4c-4a3f-99f6-75a83cc7fad6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-511514027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c890d8-efcb-4a94-884b-e02ca09086ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3818c89bb5d84a4e9bf66e61ddec3061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:12:13Z,use_quota=True,user_id='5b524472ba854d3eb5eb6167b92fc53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7cf426-238f-45b8-b424-9f5097fd2d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bb7cf426-238f-45b8-b424-9f5097fd2d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d01484-d7d2-41b3-883c-8056572e2972) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f9d01484-d7d2-41b3-883c-8056572e2972) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0c890d8-efcb-4a94-884b-e02ca09086ec', 'volume_name': 'volume-d0c890d8-efcb-4a94-884b-e02ca09086ec', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d0c320-4c44-4980-9873-c6f3556bf04c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (27d0c320-4c44-4980-9873-c6f3556bf04c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc5775c-cb93-4e4b-980e-e80394fc1f74) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:14 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Volume d0c890d8-efcb-4a94-884b-e02ca09086ec: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0c890d8-efcb-4a94-884b-e02ca09086ec', 'volume_size': 1}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:12:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-DeleteServersTestJSON-volume-511514027',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0c890d8-efcb-4a94-884b-e02ca09086ec,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3818c89bb5d84a4e9bf66e61ddec3061',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:12:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:12:13Z,use_quota=True,user_id='5b524472ba854d3eb5eb6167b92fc53a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Creating volume d0c890d8-efcb-4a94-884b-e02ca09086ec {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:12:14 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:12:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0c890d8-efcb-4a94-884b-e02ca09086ec 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:14 devstack quobyte-client[84204]: System call of process 86563 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:12:14 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=7, name=volume-d0c890d8-efcb-4a94-884b-e02ca09086ec, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:12:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0c890d8-efcb-4a94-884b-e02ca09086ec 1073741824" returned: 0 in 0.920s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0c890d8-efcb-4a94-884b-e02ca09086ec {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0c890d8-efcb-4a94-884b-e02ca09086ec" returned: 0 in 0.184s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] <== create_volume: return (1320ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:12:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.379s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (6dc5775c-cb93-4e4b-980e-e80394fc1f74) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0c890d8-efcb-4a94-884b-e02ca09086ec', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf9b645-2af0-45f0-a0e4-0297bc93dc0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:12:16 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Volume volume-d0c890d8-efcb-4a94-884b-e02ca09086ec (d0c890d8-efcb-4a94-884b-e02ca09086ec): created successfully
Sep 24 18:12:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1bf9b645-2af0-45f0-a0e4-0297bc93dc0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:12:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Flow 'volume_create_manager' (15a9df5b-bdca-4a80-b5ae-803b83d4b3d7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:12:16 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-4a2beb95-c3e7-4c76-bc54-5c9e5eb9eb8d tempest-DeleteServersTestJSON-958533061 None] Created volume successfully.
Sep 24 18:12:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-a1821c04-d936-462a-84b8-8a1c8041671a req-d99dec57-fca4-4a27-b2af-97b9fd576d45 tempest-DeleteServersTestJSON-958533061 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-a1821c04-d936-462a-84b8-8a1c8041671a req-d99dec57-fca4-4a27-b2af-97b9fd576d45 tempest-DeleteServersTestJSON-958533061 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:22 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7b1e3ed0-2c88-4ea7-a80b-435d28052cf4]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:12:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-a1821c04-d936-462a-84b8-8a1c8041671a req-d99dec57-fca4-4a27-b2af-97b9fd576d45 tempest-DeleteServersTestJSON-958533061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0c890d8-efcb-4a94-884b-e02ca09086ec {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:24 devstack quobyte-client[84204]: System call of process 86579 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:12:24 devstack quobyte-client[84204]: System call of process 86579 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:12:24 devstack quobyte-client[84204]: System call of process 86579 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:12:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-a1821c04-d936-462a-84b8-8a1c8041671a req-d99dec57-fca4-4a27-b2af-97b9fd576d45 tempest-DeleteServersTestJSON-958533061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0c890d8-efcb-4a94-884b-e02ca09086ec" returned: 0 in 2.117s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-a1821c04-d936-462a-84b8-8a1c8041671a req-d99dec57-fca4-4a27-b2af-97b9fd576d45 tempest-DeleteServersTestJSON-958533061 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.350s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-a1821c04-d936-462a-84b8-8a1c8041671a req-d99dec57-fca4-4a27-b2af-97b9fd576d45 tempest-DeleteServersTestJSON-958533061 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-d0c890d8-efcb-4a94-884b-e02ca09086ec', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'ac52f151-7af1-4c9c-87a4-09ba3aafe46e', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:12:25 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-a1821c04-d936-462a-84b8-8a1c8041671a req-d99dec57-fca4-4a27-b2af-97b9fd576d45 tempest-DeleteServersTestJSON-958533061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:26 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-a1821c04-d936-462a-84b8-8a1c8041671a req-d99dec57-fca4-4a27-b2af-97b9fd576d45 tempest-DeleteServersTestJSON-958533061 None] attachment_update completed successfully.
Sep 24 18:12:36 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=5,cinder:DELETE=1,cinder:SELECT=5 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:12:36 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=8,cinder:UPDATE=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:12:42 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-013c8896-80c7-477a-9983-fb428a2350e1 req-27f7119f-f1e1-4079-80d1-f918597d4ff1 tempest-DeleteServersTestJSON-958533061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:42 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-013c8896-80c7-477a-9983-fb428a2350e1 req-27f7119f-f1e1-4079-80d1-f918597d4ff1 tempest-DeleteServersTestJSON-958533061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:42 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-013c8896-80c7-477a-9983-fb428a2350e1 req-27f7119f-f1e1-4079-80d1-f918597d4ff1 tempest-DeleteServersTestJSON-958533061 None] Terminate volume connection completed successfully.
Sep 24 18:12:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-013c8896-80c7-477a-9983-fb428a2350e1 req-27f7119f-f1e1-4079-80d1-f918597d4ff1 tempest-DeleteServersTestJSON-958533061 None] Deleting attachment ac52f151-7af1-4c9c-87a4-09ba3aafe46e. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:12:47 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Acquiring lock "cinder-d0c890d8-efcb-4a94-884b-e02ca09086ec-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:12:47 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Lock "cinder-d0c890d8-efcb-4a94-884b-e02ca09086ec-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:12:47 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:12:47 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Acquiring lock "cinder-quobyte-d0c890d8-efcb-4a94-884b-e02ca09086ec" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:12:47 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Lock "cinder-quobyte-d0c890d8-efcb-4a94-884b-e02ca09086ec" acquired by "delete_volume" :: waited 0.017s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:12:47 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1aeaa3d4-34bb-4ff2-b5b9-d16e584747f2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:12:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0c890d8-efcb-4a94-884b-e02ca09086ec {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0c890d8-efcb-4a94-884b-e02ca09086ec" returned: 0 in 0.626s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0c890d8-efcb-4a94-884b-e02ca09086ec {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0c890d8-efcb-4a94-884b-e02ca09086ec" returned: 0 in 0.122s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Lock "cinder-quobyte-d0c890d8-efcb-4a94-884b-e02ca09086ec" released by "delete_volume" :: held 0.936s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:12:49 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Created reservations ['1ecc31d4-b219-441b-8c08-fed79bf072b1', '2ad4e0fb-8048-4b1b-bee1-ad49a1602396', '81132235-afc3-48d4-81e7-949281210363', '7651a594-1818-4229-bbca-13e19d4a877c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:12:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:12:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:12:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:12:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:12:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:12:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:12:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.150s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:12:49 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:12:49 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Deleted volume successfully.
Sep 24 18:12:50 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-50b6943c-9498-4470-a66e-025c58ae18a2 tempest-DeleteServersTestJSON-958533061 None] Lock "cinder-d0c890d8-efcb-4a94-884b-e02ca09086ec-delete_volume" released by "delete_volume" :: held 2.421s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:12:59 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=7,cinder:UPDATE=9,cinder:INSERT=4 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:13:00 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=5,cinder:UPDATE=7,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:13:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:13:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:13:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:13:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:13:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:13:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:13:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:13:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.147s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:13:11 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:13:37 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-d37dcbcc-eebd-49ee-8405-4e34d5af9bb1 req-0b3841b2-e4f7-48fc-847a-3174372175ce tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:37 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-d37dcbcc-eebd-49ee-8405-4e34d5af9bb1 req-0b3841b2-e4f7-48fc-847a-3174372175ce tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:37 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-d37dcbcc-eebd-49ee-8405-4e34d5af9bb1 req-0b3841b2-e4f7-48fc-847a-3174372175ce tempest-TaggedBootDevicesTest-1636802067 None] Terminate volume connection completed successfully.
Sep 24 18:13:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-d37dcbcc-eebd-49ee-8405-4e34d5af9bb1 req-0b3841b2-e4f7-48fc-847a-3174372175ce tempest-TaggedBootDevicesTest-1636802067 None] Deleting attachment 3a77ef89-6d46-45aa-b8a0-46ece13e482d. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:13:38 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-d37dcbcc-eebd-49ee-8405-4e34d5af9bb1 req-5366d44f-278a-4311-a195-bf0dacf246fd tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:38 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-d37dcbcc-eebd-49ee-8405-4e34d5af9bb1 req-5366d44f-278a-4311-a195-bf0dacf246fd tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:38 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-d37dcbcc-eebd-49ee-8405-4e34d5af9bb1 req-5366d44f-278a-4311-a195-bf0dacf246fd tempest-TaggedBootDevicesTest-1636802067 None] Terminate volume connection completed successfully.
Sep 24 18:13:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-d37dcbcc-eebd-49ee-8405-4e34d5af9bb1 req-5366d44f-278a-4311-a195-bf0dacf246fd tempest-TaggedBootDevicesTest-1636802067 None] Deleting attachment e62073b7-437a-4043-8ace-c758385bd11c. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:13:39 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-d37dcbcc-eebd-49ee-8405-4e34d5af9bb1 req-f4365fd4-cc63-4a86-aaa9-fb61ad4bffa2 tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:39 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-d37dcbcc-eebd-49ee-8405-4e34d5af9bb1 req-f4365fd4-cc63-4a86-aaa9-fb61ad4bffa2 tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:39 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-d37dcbcc-eebd-49ee-8405-4e34d5af9bb1 req-f4365fd4-cc63-4a86-aaa9-fb61ad4bffa2 tempest-TaggedBootDevicesTest-1636802067 None] Terminate volume connection completed successfully.
Sep 24 18:13:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-d37dcbcc-eebd-49ee-8405-4e34d5af9bb1 req-f4365fd4-cc63-4a86-aaa9-fb61ad4bffa2 tempest-TaggedBootDevicesTest-1636802067 None] Deleting attachment 7c7a7811-5ec4-4aef-92c6-bc9e34cd4110. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:13:48 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=1,cinder:SELECT=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:13:49 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=6 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:13:50 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "cinder-8aa99ddd-3656-43fe-93fc-e3628a83e852-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:13:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Lock "cinder-8aa99ddd-3656-43fe-93fc-e3628a83e852-delete_volume" acquired by "delete_volume" :: waited 0.044s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:13:51 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "cinder-quobyte-8aa99ddd-3656-43fe-93fc-e3628a83e852" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:13:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Lock "cinder-quobyte-8aa99ddd-3656-43fe-93fc-e3628a83e852" acquired by "delete_volume" :: waited 0.076s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:13:51 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[26f8682d-29bf-4357-8c20-ba55e6f0159b]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:13:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8aa99ddd-3656-43fe-93fc-e3628a83e852 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:13:52 devstack quobyte-client[84204]: System call of process 87179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:13:52 devstack quobyte-client[84204]: System call of process 87179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:13:52 devstack quobyte-client[84204]: System call of process 87179 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:13:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8aa99ddd-3656-43fe-93fc-e3628a83e852" returned: 0 in 1.176s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:13:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8aa99ddd-3656-43fe-93fc-e3628a83e852 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:13:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8aa99ddd-3656-43fe-93fc-e3628a83e852" returned: 0 in 0.142s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:13:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Lock "cinder-quobyte-8aa99ddd-3656-43fe-93fc-e3628a83e852" released by "delete_volume" :: held 1.647s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:13:53 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Created reservations ['b0e2d17a-f1c4-4a5c-acc1-8acce1bb44a5', 'febf319f-b1de-4c95-8dc4-15b25092c54b', '1b69207a-e400-408b-b75a-1fb6ccf9dc7e', 'cc460c90-905d-4154-beb5-7d5c18964a85'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:13:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:13:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:13:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:13:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:13:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:13:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:13:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.157s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:13:54 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:13:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "cinder-af2c0856-d004-4d7b-82be-c1b55ee592ef-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:13:55 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Deleted volume successfully.
Sep 24 18:13:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Lock "cinder-af2c0856-d004-4d7b-82be-c1b55ee592ef-delete_volume" acquired by "delete_volume" :: waited 0.252s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:13:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bf566a99-201d-48bb-952d-636dc4f7ec9b tempest-TaggedBootDevicesTest-1636802067 None] Lock "cinder-8aa99ddd-3656-43fe-93fc-e3628a83e852-delete_volume" released by "delete_volume" :: held 4.546s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:13:55 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "cinder-quobyte-af2c0856-d004-4d7b-82be-c1b55ee592ef" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:13:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Lock "cinder-quobyte-af2c0856-d004-4d7b-82be-c1b55ee592ef" acquired by "delete_volume" :: waited 0.016s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:13:55 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe4e9c8-cdc3-4a72-9d5e-61d255dd09fb]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:13:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-af2c0856-d004-4d7b-82be-c1b55ee592ef {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:13:56 devstack quobyte-client[84204]: System call of process 87192 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:13:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-af2c0856-d004-4d7b-82be-c1b55ee592ef" returned: 0 in 0.624s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:13:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-af2c0856-d004-4d7b-82be-c1b55ee592ef {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:13:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-af2c0856-d004-4d7b-82be-c1b55ee592ef" returned: 0 in 0.175s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:13:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Lock "cinder-quobyte-af2c0856-d004-4d7b-82be-c1b55ee592ef" released by "delete_volume" :: held 1.159s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:13:57 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Created reservations ['82d7ecb9-4b14-4eb5-8ef6-9ab18c57e174', '292f5249-7ece-4685-81f4-41e362e7816f', '439466ef-dd4d-44cc-9e5c-ded3d5524ab7', '2233b958-79e8-486d-9eab-4ff9c892b7a2'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:13:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:13:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:13:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:13:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:13:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:13:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:13:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.206s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:13:57 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:13:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "cinder-9b9948ad-f397-4c39-8e04-05f597880144-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:13:57 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Deleted volume successfully.
Sep 24 18:13:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Lock "cinder-9b9948ad-f397-4c39-8e04-05f597880144-delete_volume" acquired by "delete_volume" :: waited 0.259s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:13:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9ad5e87a-48a0-4974-a891-3316f7ac1d53 tempest-TaggedBootDevicesTest-1636802067 None] Lock "cinder-af2c0856-d004-4d7b-82be-c1b55ee592ef-delete_volume" released by "delete_volume" :: held 2.802s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:13:58 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:13:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "cinder-quobyte-9b9948ad-f397-4c39-8e04-05f597880144" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:13:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Lock "cinder-quobyte-9b9948ad-f397-4c39-8e04-05f597880144" acquired by "delete_volume" :: waited 0.048s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:13:58 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d2147c88-9fa7-4cdb-a61b-8f95e2395cd8]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:13:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:13:59 devstack quobyte-client[84204]: System call of process 87198 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:13:59 devstack quobyte-client[84204]: System call of process 87198 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:13:59 devstack quobyte-client[84204]: System call of process 87198 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:13:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144" returned: 0 in 0.539s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:13:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:13:59 devstack quobyte-client[84204]: System call of process 87200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:13:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144" returned: 1 in 0.555s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:13:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:13:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:14:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9b9948ad-f397-4c39-8e04-05f597880144" returned: 0 in 0.117s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:14:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Lock "cinder-quobyte-9b9948ad-f397-4c39-8e04-05f597880144" released by "delete_volume" :: held 1.783s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:14:00 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Created reservations ['68aa4af9-2a9b-43bf-afa2-eb502e3816ad', '00d01d44-ea68-4061-a8bd-de55cfc48c1f', '178e7e26-b0fe-4b23-b713-631088826dde', 'f847aa22-7c30-4f29-84ab-f1d0dfd1515d'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:14:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:14:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:14:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:14:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:14:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:14:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:14:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.133s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:14:00 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:14:00 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Deleted volume successfully.
Sep 24 18:14:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-643ceeeb-129e-4996-996f-d952110fbc8e tempest-TaggedBootDevicesTest-1636802067 None] Lock "cinder-9b9948ad-f397-4c39-8e04-05f597880144-delete_volume" released by "delete_volume" :: held 3.100s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:14:10 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=14,cinder:INSERT=8,cinder:UPDATE=24,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:14:11 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=16,cinder:UPDATE=24,cinder:DELETE=2,cinder:INSERT=4 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:14:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:14:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:14:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:14:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:14:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:14:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.069s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:14:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:14:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.532s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:14:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:15:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:15:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.293s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:15:13 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:13 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Flow 'volume_create_manager' (64bd61b3-0ba0-47eb-8e65-f30fbd905f5b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca81641-10fd-4519-a013-811686a7231c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ca81641-10fd-4519-a013-811686a7231c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1624996136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f435d6-c9ca-488e-8151-ca02a78d41d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14209509d11845d6a437fce64d0bbb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:13Z,use_quota=True,user_id='d5294839b40f493ca7ae4a2e54721112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02758e4d-42a7-4ece-9036-9eae8c38e351) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02758e4d-42a7-4ece-9036-9eae8c38e351) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62ca84e-99d5-4cde-adae-2350031338bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a62ca84e-99d5-4cde-adae-2350031338bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '31f435d6-c9ca-488e-8151-ca02a78d41d3', 'volume_name': 'volume-31f435d6-c9ca-488e-8151-ca02a78d41d3', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ffaccb-06a1-40b6-a63e-c3d517939c95) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74ffaccb-06a1-40b6-a63e-c3d517939c95) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ed4ca6-28bc-4ff2-be54-bc7618ab366f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:14 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Volume 31f435d6-c9ca-488e-8151-ca02a78d41d3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-31f435d6-c9ca-488e-8151-ca02a78d41d3', 'volume_size': 1}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-1624996136',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=31f435d6-c9ca-488e-8151-ca02a78d41d3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14209509d11845d6a437fce64d0bbb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:13Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:13Z,use_quota=True,user_id='d5294839b40f493ca7ae4a2e54721112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Creating volume 31f435d6-c9ca-488e-8151-ca02a78d41d3 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:15:14 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:15:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-31f435d6-c9ca-488e-8151-ca02a78d41d3 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:14 devstack quobyte-client[84204]: System call of process 87595 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:15 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=8, name=volume-31f435d6-c9ca-488e-8151-ca02a78d41d3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:15:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-31f435d6-c9ca-488e-8151-ca02a78d41d3 1073741824" returned: 0 in 0.923s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-31f435d6-c9ca-488e-8151-ca02a78d41d3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-31f435d6-c9ca-488e-8151-ca02a78d41d3" returned: 0 in 0.291s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] <== create_volume: return (1450ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:15:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.471s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c5ed4ca6-28bc-4ff2-be54-bc7618ab366f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-31f435d6-c9ca-488e-8151-ca02a78d41d3', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c1dcea-6045-4ea4-885a-ca15cb413920) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:16 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Volume volume-31f435d6-c9ca-488e-8151-ca02a78d41d3 (31f435d6-c9ca-488e-8151-ca02a78d41d3): created successfully
Sep 24 18:15:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (77c1dcea-6045-4ea4-885a-ca15cb413920) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Flow 'volume_create_manager' (64bd61b3-0ba0-47eb-8e65-f30fbd905f5b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:16 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-2427fdba-c934-4a0e-893a-37a6ee488bbd tempest-ServersNegativeTestJSON-845915398 None] Created volume successfully.
Sep 24 18:15:19 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Flow 'volume_create_manager' (b4883936-ede6-41b3-a0be-05c5c982e877) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0165d18-ec28-4652-9024-c3781ce8fd57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d0165d18-ec28-4652-9024-c3781ce8fd57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2013795467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cc95e4-ac27-4a98-904e-1fa539415948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14209509d11845d6a437fce64d0bbb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:19Z,use_quota=True,user_id='d5294839b40f493ca7ae4a2e54721112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb31300-7b56-4aea-b94b-be2568766eb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bcb31300-7b56-4aea-b94b-be2568766eb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2b5dbe-d4a0-4f20-bb9e-8bd30cae10e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a2b5dbe-d4a0-4f20-bb9e-8bd30cae10e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '76cc95e4-ac27-4a98-904e-1fa539415948', 'volume_name': 'volume-76cc95e4-ac27-4a98-904e-1fa539415948', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc10aab-9d91-4c4f-bf79-71f7aee0c1b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dbc10aab-9d91-4c4f-bf79-71f7aee0c1b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55465ed3-51d2-4bd2-b0d3-425d5bf7647a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:19 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Volume 76cc95e4-ac27-4a98-904e-1fa539415948: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-76cc95e4-ac27-4a98-904e-1fa539415948', 'volume_size': 1}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:19Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-ServersNegativeTestJSON-volume-2013795467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=76cc95e4-ac27-4a98-904e-1fa539415948,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='14209509d11845d6a437fce64d0bbb99',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:19Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:19Z,use_quota=True,user_id='d5294839b40f493ca7ae4a2e54721112',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Creating volume 76cc95e4-ac27-4a98-904e-1fa539415948 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:15:19 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-76cc95e4-ac27-4a98-904e-1fa539415948 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:19 devstack quobyte-client[84204]: System call of process 87626 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:19 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=9, name=volume-76cc95e4-ac27-4a98-904e-1fa539415948, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-76cc95e4-ac27-4a98-904e-1fa539415948 1073741824" returned: 0 in 0.473s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-76cc95e4-ac27-4a98-904e-1fa539415948 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-76cc95e4-ac27-4a98-904e-1fa539415948" returned: 0 in 0.280s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] <== create_volume: return (879ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:15:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.892s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (55465ed3-51d2-4bd2-b0d3-425d5bf7647a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-76cc95e4-ac27-4a98-904e-1fa539415948', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f677bc44-e5a6-49db-b6f6-764914f39487) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:20 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Volume volume-76cc95e4-ac27-4a98-904e-1fa539415948 (76cc95e4-ac27-4a98-904e-1fa539415948): created successfully
Sep 24 18:15:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f677bc44-e5a6-49db-b6f6-764914f39487) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Flow 'volume_create_manager' (b4883936-ede6-41b3-a0be-05c5c982e877) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:21 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e0a9ad05-f114-462d-932e-1979101099f8 tempest-ServersNegativeTestJSON-845915398 None] Created volume successfully.
Sep 24 18:15:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Acquiring lock "cinder-76cc95e4-ac27-4a98-904e-1fa539415948-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:15:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Lock "cinder-76cc95e4-ac27-4a98-904e-1fa539415948-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:15:22 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Acquiring lock "cinder-quobyte-76cc95e4-ac27-4a98-904e-1fa539415948" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:15:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Lock "cinder-quobyte-76cc95e4-ac27-4a98-904e-1fa539415948" acquired by "delete_volume" :: waited 0.021s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:15:22 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a95a083b-c03d-43c6-9474-9bcfeb36393d]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:15:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-76cc95e4-ac27-4a98-904e-1fa539415948 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:23 devstack quobyte-client[84204]: System call of process 87662 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:23 devstack quobyte-client[84204]: System call of process 87662 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:23 devstack quobyte-client[84204]: System call of process 87662 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-76cc95e4-ac27-4a98-904e-1fa539415948" returned: 0 in 0.715s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-76cc95e4-ac27-4a98-904e-1fa539415948 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-76cc95e4-ac27-4a98-904e-1fa539415948" returned: 0 in 0.166s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:24 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Lock "cinder-quobyte-76cc95e4-ac27-4a98-904e-1fa539415948" released by "delete_volume" :: held 1.192s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:15:24 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Created reservations ['4bbb6cba-38ba-43d0-903a-272f61365508', '5eccafe4-384e-4f20-8410-9dee17c7a2a7', '26d2c9d4-eab1-48a2-b9c3-59e863327bfd', '83cde4d3-c6b7-46cb-9775-1e0f870d93c8'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:15:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.084s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:24 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:15:24 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Deleted volume successfully.
Sep 24 18:15:24 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ce093a4c-86c4-49f9-a79a-3c702b6e3855 tempest-ServersNegativeTestJSON-845915398 None] Lock "cinder-76cc95e4-ac27-4a98-904e-1fa539415948-delete_volume" released by "delete_volume" :: held 2.326s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:15:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Acquiring lock "cinder-31f435d6-c9ca-488e-8151-ca02a78d41d3-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:15:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Lock "cinder-31f435d6-c9ca-488e-8151-ca02a78d41d3-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:15:25 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Acquiring lock "cinder-quobyte-31f435d6-c9ca-488e-8151-ca02a78d41d3" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:15:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Lock "cinder-quobyte-31f435d6-c9ca-488e-8151-ca02a78d41d3" acquired by "delete_volume" :: waited 0.018s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:15:25 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[caba304c-b4ec-40a3-b32e-bae723e4edf2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:15:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-31f435d6-c9ca-488e-8151-ca02a78d41d3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:25 devstack quobyte-client[84204]: System call of process 87667 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-31f435d6-c9ca-488e-8151-ca02a78d41d3" returned: 0 in 0.660s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-31f435d6-c9ca-488e-8151-ca02a78d41d3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-31f435d6-c9ca-488e-8151-ca02a78d41d3" returned: 0 in 0.191s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Lock "cinder-quobyte-31f435d6-c9ca-488e-8151-ca02a78d41d3" released by "delete_volume" :: held 1.142s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:15:26 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Created reservations ['1469b771-b6d3-4bd3-a3d6-cff0865ba312', 'ef82ca4c-3eb9-4c5d-bfbe-e46efe989ee6', 'd00edd32-5b02-4ffc-bdc6-6694803b74e2', '3ff8aaf7-d028-4ceb-afbf-2eecd3c3eb8c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:15:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:26 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:27 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.163s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:27 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:15:27 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Deleted volume successfully.
Sep 24 18:15:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-77aa04a6-a351-4f98-971c-6d08fc9a4f42 tempest-ServersNegativeTestJSON-845915398 None] Lock "cinder-31f435d6-c9ca-488e-8151-ca02a78d41d3-delete_volume" released by "delete_volume" :: held 2.751s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:15:46 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=13,cinder:UPDATE=22,cinder:DELETE=3,cinder:INSERT=3 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:15:46 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=19,cinder:SELECT=12,cinder:INSERT=5,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:15:56 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Flow 'volume_create_manager' (395b1889-0d6a-444e-9a5d-9d44e9405c34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c9f409-ac99-47aa-9e10-652d4cb78c66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c6c9f409-ac99-47aa-9e10-652d4cb78c66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1548752808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9fe093-445a-43b4-82fc-06e964570665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7191cc94aae44c4ba262777810c03399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:56Z,use_quota=True,user_id='1dc10d0e8f28499bab5dde14b7b15ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379b7b46-b70c-420d-9fc0-e798294bb87c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (379b7b46-b70c-420d-9fc0-e798294bb87c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e18c5ba-4baf-482e-9e68-ae74e7e7c7a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2e18c5ba-4baf-482e-9e68-ae74e7e7c7a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ee9fe093-445a-43b4-82fc-06e964570665', 'volume_name': 'volume-ee9fe093-445a-43b4-82fc-06e964570665', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347576db-0b6a-4212-8e27-d01c8432b23b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (347576db-0b6a-4212-8e27-d01c8432b23b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bef895-4169-4146-9906-8a616a1c92a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:56 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Volume ee9fe093-445a-43b4-82fc-06e964570665: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ee9fe093-445a-43b4-82fc-06e964570665', 'volume_size': 1}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:15:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachSCSIVolumeTestJSON-volume-1548752808',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ee9fe093-445a-43b4-82fc-06e964570665,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='7191cc94aae44c4ba262777810c03399',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:15:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:15:56Z,use_quota=True,user_id='1dc10d0e8f28499bab5dde14b7b15ad2',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Creating volume ee9fe093-445a-43b4-82fc-06e964570665 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:15:56 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:15:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ee9fe093-445a-43b4-82fc-06e964570665 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:56 devstack quobyte-client[84204]: System call of process 87839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:56 devstack quobyte-client[84204]: System call of process 87839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:15:56 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=10, name=volume-ee9fe093-445a-43b4-82fc-06e964570665, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:15:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ee9fe093-445a-43b4-82fc-06e964570665 1073741824" returned: 0 in 1.041s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ee9fe093-445a-43b4-82fc-06e964570665 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:15:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ee9fe093-445a-43b4-82fc-06e964570665" returned: 0 in 0.216s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:15:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] <== create_volume: return (1508ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:15:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.530s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:15:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (71bef895-4169-4146-9906-8a616a1c92a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ee9fe093-445a-43b4-82fc-06e964570665', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ed1fcc-25c5-48dc-aac8-c347a399f7cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:15:58 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Volume volume-ee9fe093-445a-43b4-82fc-06e964570665 (ee9fe093-445a-43b4-82fc-06e964570665): created successfully
Sep 24 18:15:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d3ed1fcc-25c5-48dc-aac8-c347a399f7cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:15:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Flow 'volume_create_manager' (395b1889-0d6a-444e-9a5d-9d44e9405c34) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:15:58 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-2e7f27dc-42eb-4d3e-a511-faa05e1fe429 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Created volume successfully.
Sep 24 18:16:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-9d77a8ab-2c1a-4d02-a6d9-814e450d5257 req-08736000-0ce2-4b45-822c-dabae26ca14f tempest-AttachSCSIVolumeTestJSON-1992593078 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:16:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-9d77a8ab-2c1a-4d02-a6d9-814e450d5257 req-08736000-0ce2-4b45-822c-dabae26ca14f tempest-AttachSCSIVolumeTestJSON-1992593078 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:16:05 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b03d1091-4f15-499e-8ee4-d19806e02955]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:16:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-9d77a8ab-2c1a-4d02-a6d9-814e450d5257 req-08736000-0ce2-4b45-822c-dabae26ca14f tempest-AttachSCSIVolumeTestJSON-1992593078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ee9fe093-445a-43b4-82fc-06e964570665 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-9d77a8ab-2c1a-4d02-a6d9-814e450d5257 req-08736000-0ce2-4b45-822c-dabae26ca14f tempest-AttachSCSIVolumeTestJSON-1992593078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ee9fe093-445a-43b4-82fc-06e964570665" returned: 0 in 1.787s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-9d77a8ab-2c1a-4d02-a6d9-814e450d5257 req-08736000-0ce2-4b45-822c-dabae26ca14f tempest-AttachSCSIVolumeTestJSON-1992593078 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.112s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:16:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-9d77a8ab-2c1a-4d02-a6d9-814e450d5257 req-08736000-0ce2-4b45-822c-dabae26ca14f tempest-AttachSCSIVolumeTestJSON-1992593078 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-ee9fe093-445a-43b4-82fc-06e964570665', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '52efd990-3a38-49e4-a72d-ff3883722918', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:16:08 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-9d77a8ab-2c1a-4d02-a6d9-814e450d5257 req-08736000-0ce2-4b45-822c-dabae26ca14f tempest-AttachSCSIVolumeTestJSON-1992593078 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:16:08 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-9d77a8ab-2c1a-4d02-a6d9-814e450d5257 req-08736000-0ce2-4b45-822c-dabae26ca14f tempest-AttachSCSIVolumeTestJSON-1992593078 None] attachment_update completed successfully.
Sep 24 18:16:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:16:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:16:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:16:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:16:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:16:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.133s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:16:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.371s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:16:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:16:18 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=5,cinder:UPDATE=4,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:16:18 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:16:41 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-bbb2c305-506a-4a80-ada6-8524671611a5 req-5b1a4f11-2fe5-47ec-a511-fee756bc367a tempest-AttachSCSIVolumeTestJSON-1992593078 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:16:41 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-bbb2c305-506a-4a80-ada6-8524671611a5 req-5b1a4f11-2fe5-47ec-a511-fee756bc367a tempest-AttachSCSIVolumeTestJSON-1992593078 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:16:41 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-bbb2c305-506a-4a80-ada6-8524671611a5 req-5b1a4f11-2fe5-47ec-a511-fee756bc367a tempest-AttachSCSIVolumeTestJSON-1992593078 None] Terminate volume connection completed successfully.
Sep 24 18:16:41 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-bbb2c305-506a-4a80-ada6-8524671611a5 req-5b1a4f11-2fe5-47ec-a511-fee756bc367a tempest-AttachSCSIVolumeTestJSON-1992593078 None] Deleting attachment 52efd990-3a38-49e4-a72d-ff3883722918. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:16:51 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:16:59 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Flow 'volume_create_manager' (8d3b3af4-8f0d-4710-8046-3851cfae5fa7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608e84ee-b182-4fb2-ae1c-aeab25be9557) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (608e84ee-b182-4fb2-ae1c-aeab25be9557) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1020088867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8124be2-315f-4ef6-ab52-7483cb3dd66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a559334083a648e2bf381a53d9f2a1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:16:59Z,use_quota=True,user_id='d4c8aa7492414f758f110a16021747eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb24ca6-eb05-4781-9562-0afe597a244a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8cb24ca6-eb05-4781-9562-0afe597a244a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59e8f06-57f1-4321-b9fa-e9924c35f5d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a59e8f06-57f1-4321-b9fa-e9924c35f5d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c8124be2-315f-4ef6-ab52-7483cb3dd66f', 'volume_name': 'volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6320eae9-b3eb-4fa6-bece-04f36ca940b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6320eae9-b3eb-4fa6-bece-04f36ca940b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41c34f4-e8f9-4ede-8d1e-985b12cc622e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:16:59 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume c8124be2-315f-4ef6-ab52-7483cb3dd66f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f', 'volume_size': 1}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:16:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-1020088867',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c8124be2-315f-4ef6-ab52-7483cb3dd66f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a559334083a648e2bf381a53d9f2a1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:16:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:16:59Z,use_quota=True,user_id='d4c8aa7492414f758f110a16021747eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Creating volume c8124be2-315f-4ef6-ab52-7483cb3dd66f {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.035s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:16:59 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:16:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:16:59 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=11, name=volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:17:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f 1073741824" returned: 0 in 1.010s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:17:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:17:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f" returned: 0 in 0.244s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:17:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] <== create_volume: return (1390ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:17:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.409s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:17:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b41c34f4-e8f9-4ede-8d1e-985b12cc622e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:17:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc99814-150c-4cee-913b-089ddbbf7d90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:17:01 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f (c8124be2-315f-4ef6-ab52-7483cb3dd66f): created successfully
Sep 24 18:17:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0fc99814-150c-4cee-913b-089ddbbf7d90) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:17:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Flow 'volume_create_manager' (8d3b3af4-8f0d-4710-8046-3851cfae5fa7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:17:01 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1deaaee4-c804-479f-a816-5497efd36028 tempest-AttachVolumeShelveTestJSON-1516315081 None] Created volume successfully.
Sep 24 18:17:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Acquiring lock "cinder-ee9fe093-445a-43b4-82fc-06e964570665-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:17:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Lock "cinder-ee9fe093-445a-43b4-82fc-06e964570665-delete_volume" acquired by "delete_volume" :: waited 0.073s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:17:02 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:17:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Acquiring lock "cinder-quobyte-ee9fe093-445a-43b4-82fc-06e964570665" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:17:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Lock "cinder-quobyte-ee9fe093-445a-43b4-82fc-06e964570665" acquired by "delete_volume" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:17:03 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d135916-dff8-4892-826f-0e3ccd4b23c0]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:17:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ee9fe093-445a-43b4-82fc-06e964570665 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:17:03 devstack quobyte-client[84204]: System call of process 88559 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:17:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ee9fe093-445a-43b4-82fc-06e964570665" returned: 0 in 0.645s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:17:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ee9fe093-445a-43b4-82fc-06e964570665 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:17:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ee9fe093-445a-43b4-82fc-06e964570665" returned: 0 in 0.179s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:17:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Lock "cinder-quobyte-ee9fe093-445a-43b4-82fc-06e964570665" released by "delete_volume" :: held 1.227s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:17:04 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Created reservations ['f577249f-8d69-499e-a6c8-2cb17f670f4b', '150d841c-c91f-4a5e-b33a-7bb0ed5f12b0', '6455107a-d3b3-4311-bbf0-e83ede4e5d50', '85c36579-b52f-484a-a26e-698340039bb7'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:17:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:17:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:17:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:17:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:17:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:17:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:17:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.394s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:17:05 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:17:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Deleted volume successfully.
Sep 24 18:17:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-959f9c5c-af91-4a09-adb4-9c427280b5b9 tempest-AttachSCSIVolumeTestJSON-1992593078 None] Lock "cinder-ee9fe093-445a-43b4-82fc-06e964570665-delete_volume" released by "delete_volume" :: held 3.695s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:17:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:17:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:17:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:17:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:17:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:17:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.101s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:17:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:17:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.507s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:17:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:17:15 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=8,cinder:SELECT=4,cinder:DELETE=1,cinder:INSERT=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:17:16 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=8,cinder:UPDATE=12,cinder:INSERT=3,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:17:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-7fba93aa-c545-427b-9f5e-29bdc7cd6310 req-c1682ae2-380f-452f-8616-09e3e2ef4d56 tempest-AttachVolumeShelveTestJSON-1516315081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:17:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-7fba93aa-c545-427b-9f5e-29bdc7cd6310 req-c1682ae2-380f-452f-8616-09e3e2ef4d56 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:17:37 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4d51ecab-42cc-4afb-94aa-90ee74439d43]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:17:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-7fba93aa-c545-427b-9f5e-29bdc7cd6310 req-c1682ae2-380f-452f-8616-09e3e2ef4d56 tempest-AttachVolumeShelveTestJSON-1516315081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:17:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-7fba93aa-c545-427b-9f5e-29bdc7cd6310 req-c1682ae2-380f-452f-8616-09e3e2ef4d56 tempest-AttachVolumeShelveTestJSON-1516315081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f" returned: 0 in 0.515s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:17:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-7fba93aa-c545-427b-9f5e-29bdc7cd6310 req-c1682ae2-380f-452f-8616-09e3e2ef4d56 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.574s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:17:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-7fba93aa-c545-427b-9f5e-29bdc7cd6310 req-c1682ae2-380f-452f-8616-09e3e2ef4d56 tempest-AttachVolumeShelveTestJSON-1516315081 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'be325b68-7ab6-44ac-ad60-3c4b87aba9ab', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:17:37 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-7fba93aa-c545-427b-9f5e-29bdc7cd6310 req-c1682ae2-380f-452f-8616-09e3e2ef4d56 tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:17:37 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-7fba93aa-c545-427b-9f5e-29bdc7cd6310 req-c1682ae2-380f-452f-8616-09e3e2ef4d56 tempest-AttachVolumeShelveTestJSON-1516315081 None] attachment_update completed successfully.
Sep 24 18:17:47 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=1,cinder:SELECT=4 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:17:47 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=8,cinder:UPDATE=3 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:18:03 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:18:03 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:18:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Flow 'volume_create_manager' (203fc087-54aa-4bac-b216-75ee8bb61602) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:18:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152201f6-5275-4b42-9966-faf9edf032c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (152201f6-5275-4b42-9966-faf9edf032c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1500726145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957aa94e-dd9d-4744-b2d8-5c1ef05710c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='664e82407d884e228707d379134f3dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:18:03Z,use_quota=True,user_id='c8efcf59bdec4de7beccf40a8a40c051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f661a9a7-ce43-48a6-a68e-971d3642347d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f661a9a7-ce43-48a6-a68e-971d3642347d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e99230-1bc1-41a6-96cc-2dd30fdf510d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (49e99230-1bc1-41a6-96cc-2dd30fdf510d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '957aa94e-dd9d-4744-b2d8-5c1ef05710c0', 'volume_name': 'volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ec73c0-3c02-44a5-8816-73e907214776) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3ec73c0-3c02-44a5-8816-73e907214776) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02c0657-6821-4da9-9609-b199128c0a34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:18:04 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Volume 957aa94e-dd9d-4744-b2d8-5c1ef05710c0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0', 'volume_size': 1}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:18:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1500726145',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=957aa94e-dd9d-4744-b2d8-5c1ef05710c0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='664e82407d884e228707d379134f3dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:18:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:18:03Z,use_quota=True,user_id='c8efcf59bdec4de7beccf40a8a40c051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Creating volume 957aa94e-dd9d-4744-b2d8-5c1ef05710c0 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:18:04 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:18:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:18:04 devstack quobyte-client[84204]: System call of process 88833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:18:04 devstack quobyte-client[84204]: System call of process 88833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:18:04 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=12, name=volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:18:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0 1073741824" returned: 0 in 0.962s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:18:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:18:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0" returned: 0 in 0.213s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:18:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] <== create_volume: return (1298ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:18:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:18:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d02c0657-6821-4da9-9609-b199128c0a34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:18:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5fe48b-a34b-400a-aae9-ecf975e6c4f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:18:05 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Volume volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0 (957aa94e-dd9d-4744-b2d8-5c1ef05710c0): created successfully
Sep 24 18:18:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0a5fe48b-a34b-400a-aae9-ecf975e6c4f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:18:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Flow 'volume_create_manager' (203fc087-54aa-4bac-b216-75ee8bb61602) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:18:06 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-2b0c86c5-ecfe-4729-946c-3f14fe19d9c7 tempest-AttachVolumeTestJSON-1141657426 None] Created volume successfully.
Sep 24 18:18:11 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Flow 'volume_create_manager' (b32d7314-a482-42eb-8454-687db4546524) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f950d01-0796-48d6-95ef-7198b221c619) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f950d01-0796-48d6-95ef-7198b221c619) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1875265092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b07259-0636-4a91-937b-e5a7ccdffb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f315f17f0fe4a349cba9a389a8e9759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:18:11Z,use_quota=True,user_id='2f4ad2c32c8a477b9576e1c1dceb4d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5b26e8-fb87-4ae7-bd7e-f7eeea67dc08) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3b5b26e8-fb87-4ae7-bd7e-f7eeea67dc08) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc4bfe0-be6d-45ef-ab4c-309ee20f8703) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2fc4bfe0-be6d-45ef-ab4c-309ee20f8703) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd0b07259-0636-4a91-937b-e5a7ccdffb49', 'volume_name': 'volume-d0b07259-0636-4a91-937b-e5a7ccdffb49', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a510cffe-121c-4eb5-b130-96c20d28d0a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a510cffe-121c-4eb5-b130-96c20d28d0a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b97c17-4766-4148-af1f-8e3d0f19c551) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:18:11 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Volume d0b07259-0636-4a91-937b-e5a7ccdffb49: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d0b07259-0636-4a91-937b-e5a7ccdffb49', 'volume_size': 1}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:18:11Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TaggedAttachmentsTest-volume-1875265092',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d0b07259-0636-4a91-937b-e5a7ccdffb49,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8f315f17f0fe4a349cba9a389a8e9759',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:18:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:18:11Z,use_quota=True,user_id='2f4ad2c32c8a477b9576e1c1dceb4d80',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Creating volume d0b07259-0636-4a91-937b-e5a7ccdffb49 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.058s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:18:11 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0b07259-0636-4a91-937b-e5a7ccdffb49 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:18:11 devstack quobyte-client[84204]: System call of process 88844 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:18:11 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=13, name=volume-d0b07259-0636-4a91-937b-e5a7ccdffb49, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.040s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:18:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:18:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0b07259-0636-4a91-937b-e5a7ccdffb49 1073741824" returned: 0 in 0.596s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:18:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0b07259-0636-4a91-937b-e5a7ccdffb49 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:18:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.496s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:18:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:18:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0b07259-0636-4a91-937b-e5a7ccdffb49" returned: 0 in 0.437s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:18:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] <== create_volume: return (1157ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:18:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.185s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:18:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (64b97c17-4766-4148-af1f-8e3d0f19c551) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d0b07259-0636-4a91-937b-e5a7ccdffb49', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:18:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50691f41-7ff9-42bc-8721-6f640ff5c0ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:18:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-d92fbb8d-c46b-4458-abbe-e9e85ddc19d2 req-b5d05469-bf5d-43a3-a06e-89fc183120cc tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:18:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-d92fbb8d-c46b-4458-abbe-e9e85ddc19d2 req-b5d05469-bf5d-43a3-a06e-89fc183120cc tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.007s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:18:13 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Volume volume-d0b07259-0636-4a91-937b-e5a7ccdffb49 (d0b07259-0636-4a91-937b-e5a7ccdffb49): created successfully
Sep 24 18:18:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (50691f41-7ff9-42bc-8721-6f640ff5c0ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:18:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Flow 'volume_create_manager' (b32d7314-a482-42eb-8454-687db4546524) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:18:13 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f22a8e0e-b8d2-49d7-b784-2d733f7d7c8d]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:18:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-d92fbb8d-c46b-4458-abbe-e9e85ddc19d2 req-b5d05469-bf5d-43a3-a06e-89fc183120cc tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:18:13 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-9525249a-19a1-414f-b926-2e4060cb2bdc tempest-TaggedAttachmentsTest-1502863884 None] Created volume successfully.
Sep 24 18:18:14 devstack quobyte-client[84204]: System call of process 88852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:18:14 devstack quobyte-client[84204]: System call of process 88852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:18:14 devstack quobyte-client[84204]: System call of process 88852 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:18:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-d92fbb8d-c46b-4458-abbe-e9e85ddc19d2 req-b5d05469-bf5d-43a3-a06e-89fc183120cc tempest-AttachVolumeTestJSON-1141657426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0" returned: 0 in 0.877s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:18:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-d92fbb8d-c46b-4458-abbe-e9e85ddc19d2 req-b5d05469-bf5d-43a3-a06e-89fc183120cc tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.944s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:18:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-d92fbb8d-c46b-4458-abbe-e9e85ddc19d2 req-b5d05469-bf5d-43a3-a06e-89fc183120cc tempest-AttachVolumeTestJSON-1141657426 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '368f9c72-ffb3-4149-ad84-5e220a79a9b4', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:18:14 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-d92fbb8d-c46b-4458-abbe-e9e85ddc19d2 req-b5d05469-bf5d-43a3-a06e-89fc183120cc tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:18:14 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-d92fbb8d-c46b-4458-abbe-e9e85ddc19d2 req-b5d05469-bf5d-43a3-a06e-89fc183120cc tempest-AttachVolumeTestJSON-1141657426 None] attachment_update completed successfully.
Sep 24 18:18:24 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=6,cinder:DELETE=2,cinder:SELECT=4 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:18:24 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=11,cinder:UPDATE=5 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:19:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:19:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:19:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:19:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:19:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:19:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:19:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:19:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.200s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:19:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:19:46 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:19:46 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:20:00 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-6b4a3dcf-746b-40e9-92a5-8468f1ed4e76 req-03cad491-b753-452e-8af7-728443eeea1a tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:20:00 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-6b4a3dcf-746b-40e9-92a5-8468f1ed4e76 req-03cad491-b753-452e-8af7-728443eeea1a tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:20:00 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-6b4a3dcf-746b-40e9-92a5-8468f1ed4e76 req-03cad491-b753-452e-8af7-728443eeea1a tempest-AttachVolumeShelveTestJSON-1516315081 None] Terminate volume connection completed successfully.
Sep 24 18:20:00 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-6b4a3dcf-746b-40e9-92a5-8468f1ed4e76 req-03cad491-b753-452e-8af7-728443eeea1a tempest-AttachVolumeShelveTestJSON-1516315081 None] Deleting attachment be325b68-7ab6-44ac-ad60-3c4b87aba9ab. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:20:10 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:20:10 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:20:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:20:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:20:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:20:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:20:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:20:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:20:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:20:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.084s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:20:11 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:20:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-dd08941c-0a35-490a-a5ab-b3efba3ef13c req-def96b4b-06ed-498f-b511-e82708b2ec3f tempest-TaggedAttachmentsTest-1502863884 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:20:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-dd08941c-0a35-490a-a5ab-b3efba3ef13c req-def96b4b-06ed-498f-b511-e82708b2ec3f tempest-TaggedAttachmentsTest-1502863884 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:20:23 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1b4b752-d57a-43e7-8fd6-be918436b371]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:20:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-dd08941c-0a35-490a-a5ab-b3efba3ef13c req-def96b4b-06ed-498f-b511-e82708b2ec3f tempest-TaggedAttachmentsTest-1502863884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0b07259-0636-4a91-937b-e5a7ccdffb49 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:20:24 devstack quobyte-client[84204]: System call of process 89947 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:20:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-dd08941c-0a35-490a-a5ab-b3efba3ef13c req-def96b4b-06ed-498f-b511-e82708b2ec3f tempest-TaggedAttachmentsTest-1502863884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0b07259-0636-4a91-937b-e5a7ccdffb49" returned: 0 in 0.639s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:20:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-dd08941c-0a35-490a-a5ab-b3efba3ef13c req-def96b4b-06ed-498f-b511-e82708b2ec3f tempest-TaggedAttachmentsTest-1502863884 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.728s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:20:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-dd08941c-0a35-490a-a5ab-b3efba3ef13c req-def96b4b-06ed-498f-b511-e82708b2ec3f tempest-TaggedAttachmentsTest-1502863884 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-d0b07259-0636-4a91-937b-e5a7ccdffb49', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b8a6bbf1-db0f-4771-8db9-68dd5118efe2', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:20:24 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-dd08941c-0a35-490a-a5ab-b3efba3ef13c req-def96b4b-06ed-498f-b511-e82708b2ec3f tempest-TaggedAttachmentsTest-1502863884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:20:24 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-dd08941c-0a35-490a-a5ab-b3efba3ef13c req-def96b4b-06ed-498f-b511-e82708b2ec3f tempest-TaggedAttachmentsTest-1502863884 None] attachment_update completed successfully.
Sep 24 18:20:33 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-b82fd654-4140-4b27-b15a-905035a204dc req-34f2d727-e1de-437c-b84b-89827ee7ea65 tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:20:33 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-b82fd654-4140-4b27-b15a-905035a204dc req-34f2d727-e1de-437c-b84b-89827ee7ea65 tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:20:33 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-b82fd654-4140-4b27-b15a-905035a204dc req-34f2d727-e1de-437c-b84b-89827ee7ea65 tempest-AttachVolumeTestJSON-1141657426 None] Terminate volume connection completed successfully.
Sep 24 18:20:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-b82fd654-4140-4b27-b15a-905035a204dc req-34f2d727-e1de-437c-b84b-89827ee7ea65 tempest-AttachVolumeTestJSON-1141657426 None] Deleting attachment 368f9c72-ffb3-4149-ad84-5e220a79a9b4. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:20:43 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=9,cinder:UPDATE=3 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:20:43 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=4 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:20:56 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-bf6447c9-3943-4e76-90ed-2b3c16fa5f38 req-9d0e961d-7664-4690-8b21-fd24de053ad9 tempest-TaggedAttachmentsTest-1502863884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:20:56 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-bf6447c9-3943-4e76-90ed-2b3c16fa5f38 req-9d0e961d-7664-4690-8b21-fd24de053ad9 tempest-TaggedAttachmentsTest-1502863884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:20:56 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-bf6447c9-3943-4e76-90ed-2b3c16fa5f38 req-9d0e961d-7664-4690-8b21-fd24de053ad9 tempest-TaggedAttachmentsTest-1502863884 None] Terminate volume connection completed successfully.
Sep 24 18:20:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-bf6447c9-3943-4e76-90ed-2b3c16fa5f38 req-9d0e961d-7664-4690-8b21-fd24de053ad9 tempest-TaggedAttachmentsTest-1502863884 None] Deleting attachment b8a6bbf1-db0f-4771-8db9-68dd5118efe2. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:21:06 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:21:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:21:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:21:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:21:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:21:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:21:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:21:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:21:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.147s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:21:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:21:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Acquiring lock "cinder-d0b07259-0636-4a91-937b-e5a7ccdffb49-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:21:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Lock "cinder-d0b07259-0636-4a91-937b-e5a7ccdffb49-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:21:45 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:21:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Acquiring lock "cinder-quobyte-d0b07259-0636-4a91-937b-e5a7ccdffb49" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:21:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Lock "cinder-quobyte-d0b07259-0636-4a91-937b-e5a7ccdffb49" acquired by "delete_volume" :: waited 0.025s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:21:45 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[145e17ef-4703-4453-9fa6-0ec873cc7e11]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:21:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0b07259-0636-4a91-937b-e5a7ccdffb49 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:21:45 devstack quobyte-client[84204]: System call of process 90474 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0b07259-0636-4a91-937b-e5a7ccdffb49" returned: 0 in 0.475s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0b07259-0636-4a91-937b-e5a7ccdffb49 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d0b07259-0636-4a91-937b-e5a7ccdffb49" returned: 0 in 0.096s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Lock "cinder-quobyte-d0b07259-0636-4a91-937b-e5a7ccdffb49" released by "delete_volume" :: held 0.745s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Created reservations ['81a51ee8-3b79-4bcc-b77f-b44dd65a3937', 'ad2069f8-5658-4168-a96d-66b478d71bf5', '7060fa9e-a956-4699-aa0d-2095dca9e628', 'b42a0b17-6cd5-40f3-8f07-0f67cccfde2e'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.082s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:21:46 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Deleted volume successfully.
Sep 24 18:21:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cf8009d0-9dd4-482e-aa80-5b674158e58d tempest-TaggedAttachmentsTest-1502863884 None] Lock "cinder-d0b07259-0636-4a91-937b-e5a7ccdffb49-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:21:54 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:21:54 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Flow 'volume_create_manager' (1fac28c7-05f4-498e-871c-06db46775638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2761f6b1-115a-4abb-a5e0-b9208bef119f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2761f6b1-115a-4abb-a5e0-b9208bef119f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-135182060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83828a67-0fc0-4299-bceb-8250d6710a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a559334083a648e2bf381a53d9f2a1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:21:55Z,use_quota=True,user_id='d4c8aa7492414f758f110a16021747eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037a4f0a-1f27-43d8-98a8-56ea59918b6f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (037a4f0a-1f27-43d8-98a8-56ea59918b6f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4408cb19-a69a-4406-a9a5-3bd32447bc2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4408cb19-a69a-4406-a9a5-3bd32447bc2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '83828a67-0fc0-4299-bceb-8250d6710a0b', 'volume_name': 'volume-83828a67-0fc0-4299-bceb-8250d6710a0b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aca8a2b-a587-486b-9150-95b5a11aa07b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3aca8a2b-a587-486b-9150-95b5a11aa07b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef03553-6ed5-4e54-8773-3c28e0662e10) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:21:55 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume 83828a67-0fc0-4299-bceb-8250d6710a0b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-83828a67-0fc0-4299-bceb-8250d6710a0b', 'volume_size': 1}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:21:54Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeShelveTestJSON-volume-135182060',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=83828a67-0fc0-4299-bceb-8250d6710a0b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a559334083a648e2bf381a53d9f2a1c2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:21:55Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:21:55Z,use_quota=True,user_id='d4c8aa7492414f758f110a16021747eb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Creating volume 83828a67-0fc0-4299-bceb-8250d6710a0b {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:21:55 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:21:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-83828a67-0fc0-4299-bceb-8250d6710a0b 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:21:55 devstack quobyte-client[84204]: System call of process 90497 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:21:55 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=14, name=volume-83828a67-0fc0-4299-bceb-8250d6710a0b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:21:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-83828a67-0fc0-4299-bceb-8250d6710a0b 1073741824" returned: 0 in 0.886s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:21:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-83828a67-0fc0-4299-bceb-8250d6710a0b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:21:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-83828a67-0fc0-4299-bceb-8250d6710a0b" returned: 0 in 0.310s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:21:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] <== create_volume: return (1349ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:21:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.370s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:21:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2ef03553-6ed5-4e54-8773-3c28e0662e10) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-83828a67-0fc0-4299-bceb-8250d6710a0b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:21:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9ef034-d3c6-495a-8665-36ed49f05efc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:21:57 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume volume-83828a67-0fc0-4299-bceb-8250d6710a0b (83828a67-0fc0-4299-bceb-8250d6710a0b): created successfully
Sep 24 18:21:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6d9ef034-d3c6-495a-8665-36ed49f05efc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:21:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Flow 'volume_create_manager' (1fac28c7-05f4-498e-871c-06db46775638) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:21:57 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-3ca6c41c-6d2c-4cab-8e9d-ab94e55f940c tempest-AttachVolumeShelveTestJSON-1516315081 None] Created volume successfully.
Sep 24 18:22:07 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=9,cinder:SELECT=6,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:22:07 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=7,cinder:UPDATE=12,cinder:INSERT=2,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:22:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:22:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:22:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:22:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:22:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:22:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.046s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:22:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:22:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.265s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:22:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:22:27 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-cf0725b2-b22c-44b8-ad75-16e835f72b7a req-35765cef-a9e9-4daa-bb3c-d7b996514a68 tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:22:27 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-cf0725b2-b22c-44b8-ad75-16e835f72b7a req-35765cef-a9e9-4daa-bb3c-d7b996514a68 tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:22:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-cf0725b2-b22c-44b8-ad75-16e835f72b7a req-35765cef-a9e9-4daa-bb3c-d7b996514a68 tempest-AttachVolumeShelveTestJSON-1516315081 None] No connector for attachment 1d55a4ab-61bd-41ba-b6ac-12c662d66d52; skipping storage backend terminate_connection call. {{(pid=84177) _connection_terminate /opt/stack/cinder/cinder/volume/manager.py:4977}}
Sep 24 18:22:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-cf0725b2-b22c-44b8-ad75-16e835f72b7a req-35765cef-a9e9-4daa-bb3c-d7b996514a68 tempest-AttachVolumeShelveTestJSON-1516315081 None] Deleting attachment 1d55a4ab-61bd-41ba-b6ac-12c662d66d52. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:22:37 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:22:37 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:23:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:23:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:23:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:23:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:23:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:23:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.075s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:23:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:23:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.501s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:23:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:23:47 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=1,cinder:UPDATE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:24:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:24:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:24:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:24:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.126s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:24:20 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Flow 'volume_create_manager' (ee6c92fa-2ddc-4e6e-8632-30a10ae91f69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f09758-4d0c-494a-9637-4b76a8dffc28) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e3f09758-4d0c-494a-9637-4b76a8dffc28) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1029975115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6600a39-9b61-4953-85f6-03daee5e93ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='664e82407d884e228707d379134f3dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:24:20Z,use_quota=True,user_id='c8efcf59bdec4de7beccf40a8a40c051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1bcc1c-7bb5-4882-b8bf-2a9aa0a9d292) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5e1bcc1c-7bb5-4882-b8bf-2a9aa0a9d292) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfe9e9a-d031-484f-856d-0716620b9220) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0bfe9e9a-d031-484f-856d-0716620b9220) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b6600a39-9b61-4953-85f6-03daee5e93ff', 'volume_name': 'volume-b6600a39-9b61-4953-85f6-03daee5e93ff', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5303ba-ca16-4281-a9eb-64ca71178547) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9d5303ba-ca16-4281-a9eb-64ca71178547) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d100bb58-537a-4d35-84dc-9773f58eb620) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:20 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Volume b6600a39-9b61-4953-85f6-03daee5e93ff: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b6600a39-9b61-4953-85f6-03daee5e93ff', 'volume_size': 1}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:24:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1029975115',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b6600a39-9b61-4953-85f6-03daee5e93ff,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='664e82407d884e228707d379134f3dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:24:20Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:24:20Z,use_quota=True,user_id='c8efcf59bdec4de7beccf40a8a40c051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Creating volume b6600a39-9b61-4953-85f6-03daee5e93ff {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:24:20 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:24:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b6600a39-9b61-4953-85f6-03daee5e93ff 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:21 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=15, name=volume-b6600a39-9b61-4953-85f6-03daee5e93ff, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:24:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b6600a39-9b61-4953-85f6-03daee5e93ff 1073741824" returned: 0 in 0.551s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b6600a39-9b61-4953-85f6-03daee5e93ff {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b6600a39-9b61-4953-85f6-03daee5e93ff" returned: 0 in 0.238s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] <== create_volume: return (913ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:24:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.924s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:22 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d100bb58-537a-4d35-84dc-9773f58eb620) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b6600a39-9b61-4953-85f6-03daee5e93ff', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:22 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf6c1f6-0553-4700-b5e3-dd1668e39912) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:22 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Volume volume-b6600a39-9b61-4953-85f6-03daee5e93ff (b6600a39-9b61-4953-85f6-03daee5e93ff): created successfully
Sep 24 18:24:22 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bf6c1f6-0553-4700-b5e3-dd1668e39912) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:22 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Flow 'volume_create_manager' (ee6c92fa-2ddc-4e6e-8632-30a10ae91f69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:24:22 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-ccc4096f-0a5a-4fe8-be32-35c0c595b559 tempest-AttachVolumeTestJSON-1141657426 None] Created volume successfully.
Sep 24 18:24:25 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Flow 'volume_create_manager' (96fb99eb-a827-4fee-a8bd-a18424d31516) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1222969b-40c1-4a45-9abe-88f95f503735) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1222969b-40c1-4a45-9abe-88f95f503735) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1791918897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9eb615-4d10-4c07-97b7-235e67d8d1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7faf64add954eae87c54925fe5b8e32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:24:25Z,use_quota=True,user_id='97b7aa2eda1545fbb7409f3e12ea1adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5344bec1-9fb4-46a1-92b7-1f9f87bd5f30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (5344bec1-9fb4-46a1-92b7-1f9f87bd5f30) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b4b63c-6acb-4c07-a9fc-dc6051202670) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e5b4b63c-6acb-4c07-a9fc-dc6051202670) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2e9eb615-4d10-4c07-97b7-235e67d8d1aa', 'volume_name': 'volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea59b25d-76a3-4f47-9817-7e5477d40be6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ea59b25d-76a3-4f47-9817-7e5477d40be6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d1e73d-1704-4f34-ab80-159188e560ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:25 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Volume 2e9eb615-4d10-4c07-97b7-235e67d8d1aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa', 'volume_size': 1}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:24:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1791918897',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2e9eb615-4d10-4c07-97b7-235e67d8d1aa,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7faf64add954eae87c54925fe5b8e32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:24:25Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:24:25Z,use_quota=True,user_id='97b7aa2eda1545fbb7409f3e12ea1adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Creating volume 2e9eb615-4d10-4c07-97b7-235e67d8d1aa {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:24:25 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:24:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:26 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=16, name=volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:24:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa 1073741824" returned: 0 in 0.695s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa" returned: 0 in 0.232s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:27 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] <== create_volume: return (1128ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:24:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.162s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d1e73d-1704-4f34-ab80-159188e560ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257f6203-8fdf-4737-a916-751e35fd49b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:27 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Volume volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa (2e9eb615-4d10-4c07-97b7-235e67d8d1aa): created successfully
Sep 24 18:24:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (257f6203-8fdf-4737-a916-751e35fd49b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Flow 'volume_create_manager' (96fb99eb-a827-4fee-a8bd-a18424d31516) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:24:27 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-cf96a24f-acd9-428f-8722-eb9a7fe515d8 tempest-AttachVolumeNegativeTest-1266788567 None] Created volume successfully.
Sep 24 18:24:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-a8f43341-1b93-464a-b521-dc38e3123d26 req-0d768d95-e9f9-4d87-8786-265b4de0b510 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-a8f43341-1b93-464a-b521-dc38e3123d26 req-0d768d95-e9f9-4d87-8786-265b4de0b510 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:28 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed57ed6f-eb85-4d52-9ac9-3becf5bcc6d5]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:24:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-a8f43341-1b93-464a-b521-dc38e3123d26 req-0d768d95-e9f9-4d87-8786-265b4de0b510 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b6600a39-9b61-4953-85f6-03daee5e93ff {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-a8f43341-1b93-464a-b521-dc38e3123d26 req-0d768d95-e9f9-4d87-8786-265b4de0b510 tempest-AttachVolumeTestJSON-1141657426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b6600a39-9b61-4953-85f6-03daee5e93ff" returned: 0 in 0.542s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-a8f43341-1b93-464a-b521-dc38e3123d26 req-0d768d95-e9f9-4d87-8786-265b4de0b510 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.614s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-a8f43341-1b93-464a-b521-dc38e3123d26 req-0d768d95-e9f9-4d87-8786-265b4de0b510 tempest-AttachVolumeTestJSON-1141657426 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-b6600a39-9b61-4953-85f6-03daee5e93ff', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '910abd47-69a7-4adb-8c65-2e761983a140', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:24:29 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-a8f43341-1b93-464a-b521-dc38e3123d26 req-0d768d95-e9f9-4d87-8786-265b4de0b510 tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:24:29 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-a8f43341-1b93-464a-b521-dc38e3123d26 req-0d768d95-e9f9-4d87-8786-265b4de0b510 tempest-AttachVolumeTestJSON-1141657426 None] attachment_update completed successfully.
Sep 24 18:24:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-d3139def-076e-416e-a658-09e12ac6b5ff req-e609c8cd-2913-4079-bdd0-5b663fabb7e8 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-d3139def-076e-416e-a658-09e12ac6b5ff req-e609c8cd-2913-4079-bdd0-5b663fabb7e8 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:31 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[184bf30a-9d4d-4ada-aab5-75a4873d5fec]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:24:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-d3139def-076e-416e-a658-09e12ac6b5ff req-e609c8cd-2913-4079-bdd0-5b663fabb7e8 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:33 devstack quobyte-client[84204]: System call of process 91654 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:24:33 devstack quobyte-client[84204]: System call of process 91654 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:24:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-d3139def-076e-416e-a658-09e12ac6b5ff req-e609c8cd-2913-4079-bdd0-5b663fabb7e8 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa" returned: 0 in 1.795s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-d3139def-076e-416e-a658-09e12ac6b5ff req-e609c8cd-2913-4079-bdd0-5b663fabb7e8 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.882s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-d3139def-076e-416e-a658-09e12ac6b5ff req-e609c8cd-2913-4079-bdd0-5b663fabb7e8 tempest-AttachVolumeNegativeTest-1266788567 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'b554820c-d1fa-49f3-bfa4-46f5c2a37fe3', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:24:34 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-d3139def-076e-416e-a658-09e12ac6b5ff req-e609c8cd-2913-4079-bdd0-5b663fabb7e8 tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:24:35 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-d3139def-076e-416e-a658-09e12ac6b5ff req-e609c8cd-2913-4079-bdd0-5b663fabb7e8 tempest-AttachVolumeNegativeTest-1266788567 None] attachment_update completed successfully.
Sep 24 18:24:38 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:24:38 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:24:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Flow 'volume_create_manager' (da6dae47-9524-4f79-8bf2-b1b02d19c415) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:24:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e697204-c262-4c69-9934-6b543f36a334) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e697204-c262-4c69-9934-6b543f36a334) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1289652386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1ab148-e5e4-449d-96d3-8f9c85db3b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='664e82407d884e228707d379134f3dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:24:39Z,use_quota=True,user_id='c8efcf59bdec4de7beccf40a8a40c051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a181c256-f737-4da7-a492-58cdfc11c9ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a181c256-f737-4da7-a492-58cdfc11c9ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c562e686-5904-44bf-aa66-72895c6c8197) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c562e686-5904-44bf-aa66-72895c6c8197) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3a1ab148-e5e4-449d-96d3-8f9c85db3b6b', 'volume_name': 'volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad2625a-2133-455d-b859-0a78cc398173) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1ad2625a-2133-455d-b859-0a78cc398173) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03702313-794c-4dee-b407-6ef5dd412f9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:39 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Volume 3a1ab148-e5e4-449d-96d3-8f9c85db3b6b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b', 'volume_size': 1}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:24:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeTestJSON-volume-1289652386',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3a1ab148-e5e4-449d-96d3-8f9c85db3b6b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='664e82407d884e228707d379134f3dc8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:24:39Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:24:39Z,use_quota=True,user_id='c8efcf59bdec4de7beccf40a8a40c051',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Creating volume 3a1ab148-e5e4-449d-96d3-8f9c85db3b6b {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:24:39 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:39 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=17, name=volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b 1073741824" returned: 0 in 0.512s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b" returned: 0 in 0.128s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] <== create_volume: return (736ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:24:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.757s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03702313-794c-4dee-b407-6ef5dd412f9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6cb53ab-019f-4429-ac28-e5fd44428171) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:24:40 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Volume volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b (3a1ab148-e5e4-449d-96d3-8f9c85db3b6b): created successfully
Sep 24 18:24:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e6cb53ab-019f-4429-ac28-e5fd44428171) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:24:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Flow 'volume_create_manager' (da6dae47-9524-4f79-8bf2-b1b02d19c415) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:24:40 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-85e4fe6f-998c-4863-837f-d67be88aa800 tempest-AttachVolumeTestJSON-1141657426 None] Created volume successfully.
Sep 24 18:24:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-bda059c2-b72b-44f6-9a8d-fa5530c14ce7 req-c01958aa-62eb-4719-8a66-51024247711f tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-bda059c2-b72b-44f6-9a8d-fa5530c14ce7 req-c01958aa-62eb-4719-8a66-51024247711f tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:45 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e7bdaeda-7d60-4e01-bc25-57139fc23e29]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:24:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-bda059c2-b72b-44f6-9a8d-fa5530c14ce7 req-c01958aa-62eb-4719-8a66-51024247711f tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Acquiring lock "cinder-83828a67-0fc0-4299-bceb-8250d6710a0b-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:24:45 devstack quobyte-client[84204]: System call of process 91768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:24:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-bda059c2-b72b-44f6-9a8d-fa5530c14ce7 req-c01958aa-62eb-4719-8a66-51024247711f tempest-AttachVolumeTestJSON-1141657426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b" returned: 0 in 0.802s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-bda059c2-b72b-44f6-9a8d-fa5530c14ce7 req-c01958aa-62eb-4719-8a66-51024247711f tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.842s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "cinder-83828a67-0fc0-4299-bceb-8250d6710a0b-delete_volume" acquired by "delete_volume" :: waited 0.250s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:24:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-bda059c2-b72b-44f6-9a8d-fa5530c14ce7 req-c01958aa-62eb-4719-8a66-51024247711f tempest-AttachVolumeTestJSON-1141657426 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '943fea0c-8c2b-463a-9fb3-e42eddbc3308', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:24:46 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-bda059c2-b72b-44f6-9a8d-fa5530c14ce7 req-c01958aa-62eb-4719-8a66-51024247711f tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:24:46 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:24:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Acquiring lock "cinder-quobyte-83828a67-0fc0-4299-bceb-8250d6710a0b" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:24:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "cinder-quobyte-83828a67-0fc0-4299-bceb-8250d6710a0b" acquired by "delete_volume" :: waited 0.063s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:24:46 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d167fdec-a582-43e7-a071-79845e5a13c9]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:24:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-83828a67-0fc0-4299-bceb-8250d6710a0b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:46 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-bda059c2-b72b-44f6-9a8d-fa5530c14ce7 req-c01958aa-62eb-4719-8a66-51024247711f tempest-AttachVolumeTestJSON-1141657426 None] attachment_update completed successfully.
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-83828a67-0fc0-4299-bceb-8250d6710a0b" returned: 0 in 0.647s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-83828a67-0fc0-4299-bceb-8250d6710a0b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-83828a67-0fc0-4299-bceb-8250d6710a0b" returned: 0 in 0.183s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "cinder-quobyte-83828a67-0fc0-4299-bceb-8250d6710a0b" released by "delete_volume" :: held 1.058s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Created reservations ['b1047ebc-e215-4b21-93fe-93e7728d06e9', '829ce87d-1bea-4ec2-b8ec-e531a52e2df2', '286d97ee-b63c-451f-88c9-4b60510c7c1d', 'f057b311-c21f-41e0-b147-8d515a1bd6bd'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.117s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:47 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:24:48 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Deleted volume successfully.
Sep 24 18:24:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Acquiring lock "cinder-c8124be2-315f-4ef6-ab52-7483cb3dd66f-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:24:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-12665411-1bfb-405d-8fe0-a6887b600713 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "cinder-83828a67-0fc0-4299-bceb-8250d6710a0b-delete_volume" released by "delete_volume" :: held 2.258s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:24:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "cinder-c8124be2-315f-4ef6-ab52-7483cb3dd66f-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:24:48 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:24:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Acquiring lock "cinder-quobyte-c8124be2-315f-4ef6-ab52-7483cb3dd66f" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:24:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "cinder-quobyte-c8124be2-315f-4ef6-ab52-7483cb3dd66f" acquired by "delete_volume" :: waited 0.027s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:24:48 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b2388b4a-494c-47b2-beb1-57861b3bb8ee]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:24:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:49 devstack quobyte-client[84204]: System call of process 91786 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:24:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f" returned: 0 in 0.627s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c8124be2-315f-4ef6-ab52-7483cb3dd66f" returned: 0 in 0.106s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:49 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "cinder-quobyte-c8124be2-315f-4ef6-ab52-7483cb3dd66f" released by "delete_volume" :: held 0.921s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:24:49 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Created reservations ['68dce3e3-baff-4c2b-83ab-1b84733379c4', '7bc6088e-4c23-4e66-8c60-3f9cb55b637e', 'aa463631-7e6c-418b-8c19-51de402ad6b2', 'e1a84a22-3d28-447e-b0a5-0cac4c410ba6'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:24:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:24:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:24:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:24:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:24:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:24:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:24:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.094s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:24:50 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:24:50 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Deleted volume successfully.
Sep 24 18:24:50 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6786077d-e07b-4bf1-a47c-884cb7a5a677 tempest-AttachVolumeShelveTestJSON-1516315081 None] Lock "cinder-c8124be2-315f-4ef6-ab52-7483cb3dd66f-delete_volume" released by "delete_volume" :: held 1.855s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:24:59 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=34,cinder:UPDATE=31,cinder:DELETE=2,cinder:INSERT=6 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:25:00 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=22,cinder:DELETE=3,cinder:SELECT=25,cinder:INSERT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:25:01 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Flow 'volume_create_manager' (dea03dbd-a1bc-4c32-bae4-2c1f2780aba0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037b844f-6eda-4aba-bd86-336306a81f84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (037b844f-6eda-4aba-bd86-336306a81f84) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-751299247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ebc163-4158-4209-b57e-125ad559ee7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768b06449a63475cbfe16acdfdcee4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:25:01Z,use_quota=True,user_id='d9963552913446389e2121ccae1c0243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b3757f-d360-4a13-a306-fa3213d8fc57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f9b3757f-d360-4a13-a306-fa3213d8fc57) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7907398b-7cf4-447f-835c-ce575eb711d7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7907398b-7cf4-447f-835c-ce575eb711d7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3ebc163-4158-4209-b57e-125ad559ee7d', 'volume_name': 'volume-b3ebc163-4158-4209-b57e-125ad559ee7d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758022b6-056c-4cc8-b092-78f9bcf63ca6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (758022b6-056c-4cc8-b092-78f9bcf63ca6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1724b654-ee6f-4149-9cc4-f207602cc655) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:25:01 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Volume b3ebc163-4158-4209-b57e-125ad559ee7d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3ebc163-4158-4209-b57e-125ad559ee7d', 'volume_size': 1}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:25:01Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotsTestJSON-volume-751299247',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3ebc163-4158-4209-b57e-125ad559ee7d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='768b06449a63475cbfe16acdfdcee4ea',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:25:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:25:01Z,use_quota=True,user_id='d9963552913446389e2121ccae1c0243',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Creating volume b3ebc163-4158-4209-b57e-125ad559ee7d {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:25:01 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:01 devstack quobyte-client[84204]: System call of process 91849 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:01 devstack quobyte-client[84204]: System call of process 91849 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:01 devstack quobyte-client[84204]: System call of process 91849 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:01 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=18, name=volume-b3ebc163-4158-4209-b57e-125ad559ee7d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d 1073741824" returned: 0 in 0.381s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d" returned: 0 in 0.109s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] <== create_volume: return (561ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.571s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1724b654-ee6f-4149-9cc4-f207602cc655) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3ebc163-4158-4209-b57e-125ad559ee7d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:25:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08aac4eb-1bb1-4ca4-8e0e-932cd8ec608f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:25:02 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Volume volume-b3ebc163-4158-4209-b57e-125ad559ee7d (b3ebc163-4158-4209-b57e-125ad559ee7d): created successfully
Sep 24 18:25:02 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (08aac4eb-1bb1-4ca4-8e0e-932cd8ec608f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:25:02 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Flow 'volume_create_manager' (dea03dbd-a1bc-4c32-bae4-2c1f2780aba0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:25:02 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-eb579c31-56dd-4e14-b76a-fb3e7579a127 req-1e0db1e1-f92b-4cc8-aaf5-0a60a18f3792 tempest-VolumesSnapshotsTestJSON-687879314 None] Created volume successfully.
Sep 24 18:25:03 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Creating offline snapshot 92b2179f-70cd-48c2-b860-e8a52077d259 of volume b3ebc163-4158-4209-b57e-125ad559ee7d {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:25:03 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b5960282-a958-4cca-b9b2-a846082c7544]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:04 devstack quobyte-client[84204]: System call of process 91869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d" returned: 0 in 0.518s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:04 devstack quobyte-client[84204]: System call of process 91874 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:04 devstack quobyte-client[84204]: System call of process 91874 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:04 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=19, name=volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:25:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259 1G" returned: 0 in 0.273s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b3ebc163-4158-4209-b57e-125ad559ee7d -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "qemu-img rebase -u -b volume-b3ebc163-4158-4209-b57e-125ad559ee7d -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259" returned: 0 in 0.226s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:25:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259" returned: 0 in 0.606s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:25:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259" returned: 0 in 0.474s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.info" returned: 0 in 0.481s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:25:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.info" returned: 0 in 0.366s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.890s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:08 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-5d586db1-a1aa-4f24-85f0-5bc638dcb203 req-a27733d1-578c-4ae9-9339-08ac06632507 tempest-VolumesSnapshotsTestJSON-687879314 None] Create snapshot completed successfully
Sep 24 18:25:08 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Acquiring lock "cinder-92b2179f-70cd-48c2-b860-e8a52077d259-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "cinder-92b2179f-70cd-48c2-b860-e8a52077d259-delete_snapshot" acquired by "delete_snapshot" :: waited 0.032s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:25:09 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Acquiring lock "cinder-quobyte-b3ebc163-4158-4209-b57e-125ad559ee7d" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "cinder-quobyte-b3ebc163-4158-4209-b57e-125ad559ee7d" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Acquiring lock "cinder-quobyte-92b2179f-70cd-48c2-b860-e8a52077d259" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "cinder-quobyte-92b2179f-70cd-48c2-b860-e8a52077d259" acquired by "_delete_snapshot" :: waited 0.013s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Deleting offline snapshot 92b2179f-70cd-48c2-b860-e8a52077d259 of volume b3ebc163-4158-4209-b57e-125ad559ee7d {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] snapshot_file for this snap is: volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9088f828-67d1-4aa7-abc5-3f75a034003a]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:09 devstack quobyte-client[84204]: System call of process 92064 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259" returned: 0 in 0.489s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b3ebc163-4158-4209-b57e-125ad559ee7d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e1a47b51-6a1f-4055-9f2f-b509458d99c1]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:10 devstack quobyte-client[84204]: System call of process 92067 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d" returned: 0 in 0.423s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259" returned: 0 in 0.246s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d.92b2179f-70cd-48c2-b860-e8a52077d259" returned: 0 in 0.091s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "cinder-quobyte-92b2179f-70cd-48c2-b860-e8a52077d259" released by "_delete_snapshot" :: held 1.700s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:25:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "cinder-quobyte-b3ebc163-4158-4209-b57e-125ad559ee7d" released by "delete_snapshot" :: held 1.726s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:25:11 devstack cinder-volume[84177]: WARNING cinder.quota [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Deprecated: Default quota for resource: snapshots_QuobyteHD is set by the default quota flag: quota_snapshots_QuobyteHD, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:25:11 devstack cinder-volume[84177]: DEBUG cinder.quota [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Created reservations ['410a0419-bce7-4199-8156-c5adff456e31', '55804dc7-1f1e-4e5c-b4c0-3a01ca2a8ca1', '667ff362-a3f9-4a73-9e17-930c7362b388', '34e0c9ea-7858-4aae-9ba1-6bd0486a5bac'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:25:11 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Delete snapshot completed successfully.
Sep 24 18:25:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-6d519a7f-74f6-4303-9bc6-a4b35cbd4b83 req-da40e11b-17cd-462d-9bc6-637b2a8eba55 tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "cinder-92b2179f-70cd-48c2-b860-e8a52077d259-delete_snapshot" released by "delete_snapshot" :: held 2.229s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:25:11 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:25:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:25:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:25:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.110s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:25:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Acquiring lock "cinder-b3ebc163-4158-4209-b57e-125ad559ee7d-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:25:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "cinder-b3ebc163-4158-4209-b57e-125ad559ee7d-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:25:13 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Acquiring lock "cinder-quobyte-b3ebc163-4158-4209-b57e-125ad559ee7d" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:25:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "cinder-quobyte-b3ebc163-4158-4209-b57e-125ad559ee7d" acquired by "delete_volume" :: waited 0.019s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:25:13 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[61af4aac-3df2-4211-9793-a60622099da2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:13 devstack quobyte-client[84204]: System call of process 92076 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:13 devstack quobyte-client[84204]: System call of process 92076 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:13 devstack quobyte-client[84204]: System call of process 92076 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d" returned: 0 in 0.928s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3ebc163-4158-4209-b57e-125ad559ee7d" returned: 0 in 0.197s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "cinder-quobyte-b3ebc163-4158-4209-b57e-125ad559ee7d" released by "delete_volume" :: held 1.356s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:25:14 devstack cinder-volume[84177]: DEBUG cinder.quota [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Created reservations ['d2cd6f07-5dc0-477a-991f-95de4d58bab2', '3048d325-ef3b-4b65-affe-67e7869a11cb', '26fdc8c4-8494-4a11-8524-ad66262f3f2a', 'ea1c6327-49ec-4408-9f96-1d5c70201d41'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:25:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:25:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:25:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.120s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:15 devstack cinder-volume[84177]: DEBUG cinder.manager [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:25:15 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Deleted volume successfully.
Sep 24 18:25:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-05ccfd54-24ed-4f56-8ada-b15ea676fd9e req-ee2a658c-7791-4656-b4db-fb15fe0f004d tempest-VolumesSnapshotsTestJSON-687879314 None] Lock "cinder-b3ebc163-4158-4209-b57e-125ad559ee7d-delete_volume" released by "delete_volume" :: held 2.898s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:25:16 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-751aa59b-0c81-4586-857b-c497e9d981ad req-9209f3d1-b581-487a-9f00-75942a8fb17b tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:16 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-751aa59b-0c81-4586-857b-c497e9d981ad req-9209f3d1-b581-487a-9f00-75942a8fb17b tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:16 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-751aa59b-0c81-4586-857b-c497e9d981ad req-9209f3d1-b581-487a-9f00-75942a8fb17b tempest-AttachVolumeTestJSON-1141657426 None] Terminate volume connection completed successfully.
Sep 24 18:25:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-751aa59b-0c81-4586-857b-c497e9d981ad req-9209f3d1-b581-487a-9f00-75942a8fb17b tempest-AttachVolumeTestJSON-1141657426 None] Deleting attachment 910abd47-69a7-4adb-8c65-2e761983a140. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:25:22 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e619087e-64a0-4f3a-bc7e-850c3b52d8c2 tempest-BackendsCapabilitiesAdminTestsJSON-111577439 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914306640625, 'free_capacity_gb': 924.914306640625, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84177) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 24 18:25:23 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-00624a79-0a00-45ef-bb04-8ac5cf55521f tempest-BackendsCapabilitiesAdminTestsJSON-111577439 None] Obtained capabilities list: {'volume_backend_name': 'QuobyteHD', 'vendor_name': 'Open Source', 'driver_version': '1.1.13', 'storage_protocol': 'quobyte', 'total_capacity_gb': 924.914306640625, 'free_capacity_gb': 924.914306640625, 'reserved_percentage': 0, 'QoS_support': False, 'properties': {'thin_provisioning': {'title': 'Thin Provisioning', 'description': 'Sets thin provisioning.', 'type': 'boolean'}, 'compression': {'title': 'Compression', 'description': 'Enables compression.', 'type': 'boolean'}, 'qos': {'title': 'QoS', 'description': 'Enables QoS.', 'type': 'boolean'}, 'replication_enabled': {'title': 'Replication', 'description': 'Enables replication.', 'type': 'boolean'}}}. {{(pid=84177) get_capabilities /opt/stack/cinder/cinder/volume/manager.py:4797}}
Sep 24 18:25:26 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=22,cinder:DELETE=1,cinder:SELECT=12,cinder:INSERT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:25:26 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=14,cinder:UPDATE=11,cinder:DELETE=2,cinder:INSERT=6 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:25:29 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d9e8f570-966b-4bb1-be14-10aa2dc5d3da tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:29 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d9e8f570-966b-4bb1-be14-10aa2dc5d3da tempest-GroupSnapshotsTest-616484256 None] Group tempest-GroupSnapshotsTest-Group-791396295: creating
Sep 24 18:25:30 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d9e8f570-966b-4bb1-be14-10aa2dc5d3da tempest-GroupSnapshotsTest-616484256 None] Group tempest-GroupSnapshotsTest-Group-791396295: created successfully
Sep 24 18:25:30 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d9e8f570-966b-4bb1-be14-10aa2dc5d3da tempest-GroupSnapshotsTest-616484256 None] Create group completed successfully.
Sep 24 18:25:31 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Flow 'volume_create_manager' (a05155c7-e559-4445-ae45-a03319cf679d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f729eb5-35a8-47cd-9b04-44177f61ed0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1f729eb5-35a8-47cd-9b04-44177f61ed0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-632411656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f01b7f1-65a5-4dcd-9a1a-ab10f7074332,host='devstack@QuobyteHD#QuobyteHD',id=b1affc69-015f-428c-a6e4-6cb16a22da98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f718a32296a94b87aba56ed4196a817c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:25:31Z,use_quota=True,user_id='0ac5c31826ea4c5a824d515218f91e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78d680ed-5eee-49a2-b57c-2a89873f262d),volume_type_id=78d680ed-5eee-49a2-b57c-2a89873f262d)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e288b63-0a0c-40d4-959e-81e5d6e148d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3e288b63-0a0c-40d4-959e-81e5d6e148d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30102b1-a538-4030-811a-2865c265c99c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c30102b1-a538-4030-811a-2865c265c99c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b1affc69-015f-428c-a6e4-6cb16a22da98', 'volume_name': 'volume-b1affc69-015f-428c-a6e4-6cb16a22da98', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98c5270-c9bf-4c83-a541-d33b6243a6c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e98c5270-c9bf-4c83-a541-d33b6243a6c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a83cec-a10e-4938-8817-ad2f333f668f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:25:31 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Volume b1affc69-015f-428c-a6e4-6cb16a22da98: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b1affc69-015f-428c-a6e4-6cb16a22da98', 'volume_size': 1}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=6f01b7f1-65a5-4dcd-9a1a-ab10f7074332,created_at=2025-09-24T16:25:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-632411656',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=6f01b7f1-65a5-4dcd-9a1a-ab10f7074332,host='devstack@QuobyteHD#QuobyteHD',id=b1affc69-015f-428c-a6e4-6cb16a22da98,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f718a32296a94b87aba56ed4196a817c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:25:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:25:31Z,use_quota=True,user_id='0ac5c31826ea4c5a824d515218f91e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(78d680ed-5eee-49a2-b57c-2a89873f262d),volume_type_id=78d680ed-5eee-49a2-b57c-2a89873f262d)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Creating volume b1affc69-015f-428c-a6e4-6cb16a22da98 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:25:31 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:25:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:31 devstack quobyte-client[84204]: System call of process 92203 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:31 devstack quobyte-client[84204]: System call of process 92203 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:31 devstack quobyte-client[84204]: System call of process 92203 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:31 devstack quobyte-client[84204]: System call of process 92203 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:31 devstack quobyte-client[84204]: System call of process 92203 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:31 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=21, name=volume-b1affc69-015f-428c-a6e4-6cb16a22da98, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:25:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 1073741824" returned: 0 in 0.359s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98" returned: 0 in 0.094s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] <== create_volume: return (550ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:25:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.568s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (22a83cec-a10e-4938-8817-ad2f333f668f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b1affc69-015f-428c-a6e4-6cb16a22da98', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:25:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29db8a8-c2e2-4aef-8f0b-a358bec815b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:25:32 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Volume volume-b1affc69-015f-428c-a6e4-6cb16a22da98 (b1affc69-015f-428c-a6e4-6cb16a22da98): created successfully
Sep 24 18:25:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b29db8a8-c2e2-4aef-8f0b-a358bec815b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:25:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Flow 'volume_create_manager' (a05155c7-e559-4445-ae45-a03319cf679d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:25:32 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e9fc544d-0d11-403b-92b2-d4f161b0439f tempest-GroupSnapshotsTest-616484256 None] Created volume successfully.
Sep 24 18:25:34 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] GroupSnapshot b2ff6af3-42a3-4026-a930-b9a8a2635c99: creating.
Sep 24 18:25:34 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Group snapshot b2ff6af3-42a3-4026-a930-b9a8a2635c99: creating. {{(pid=84177) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 24 18:25:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Creating offline snapshot 159dbaa5-a4a5-49c7-86b1-ea5197b69546 of volume b1affc69-015f-428c-a6e4-6cb16a22da98 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:25:34 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[12841e69-c0c4-4f97-b93f-c35eb7207a8d]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:35 devstack quobyte-client[84204]: System call of process 92209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98" returned: 0 in 0.460s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:35 devstack quobyte-client[84204]: System call of process 92212 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:35 devstack quobyte-client[84204]: System call of process 92212 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:35 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=22, name=volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:25:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546 1G" returned: 0 in 0.382s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b1affc69-015f-428c-a6e4-6cb16a22da98 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:35 devstack quobyte-client[84204]: System call of process 92228 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img rebase -u -b volume-b1affc69-015f-428c-a6e4-6cb16a22da98 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546" returned: 0 in 0.268s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:25:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546" returned: 0 in 0.200s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:25:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546" returned: 0 in 0.168s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.info" returned: 0 in 0.237s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:25:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.info" returned: 0 in 0.287s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.455s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:37 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-2451a152-7622-47b4-9c6e-f9ae098aa7a3 tempest-GroupSnapshotsTest-616484256 None] group_snapshot b2ff6af3-42a3-4026-a930-b9a8a2635c99: created successfully
Sep 24 18:25:39 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-159dbaa5-a4a5-49c7-86b1-ea5197b69546-117d4c2f-7305-4217-a818-f9bc4f4796bb" by "_create_volume_from_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-159dbaa5-a4a5-49c7-86b1-ea5197b69546-117d4c2f-7305-4217-a818-f9bc4f4796bb" acquired by "_create_volume_from_snapshot" :: waited 0.029s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Creating volume 117d4c2f-7305-4217-a818-f9bc4f4796bb from snapshot 159dbaa5-a4a5-49c7-86b1-ea5197b69546 {{(pid=84177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-117d4c2f-7305-4217-a818-f9bc4f4796bb" by "_copy_volume_from_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-117d4c2f-7305-4217-a818-f9bc4f4796bb" acquired by "_copy_volume_from_snapshot" :: waited 0.024s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] snapshot: 159dbaa5-a4a5-49c7-86b1-ea5197b69546, volume: 117d4c2f-7305-4217-a818-f9bc4f4796bb,  {{(pid=84177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d0e33618-d1ea-49ac-9bfd-4a2a406b851b]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546" returned: 0 in 0.436s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1affc69-015f-428c-a6e4-6cb16a22da98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 {{(pid=84177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Creating direct copy from snapshot {{(pid=84177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[efeb1476-a4f4-4a45-8576-ddac1186f7a9]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:40 devstack quobyte-client[84204]: System call of process 92262 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98" returned: 0 in 0.475s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:40 devstack cinder-volume[84177]: DEBUG cinder.utils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-117d4c2f-7305-4217-a818-f9bc4f4796bb not found in is_blk_device check {{(pid=84177) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 24 18:25:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-117d4c2f-7305-4217-a818-f9bc4f4796bb {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:40 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=24, name=volume-117d4c2f-7305-4217-a818-f9bc4f4796bb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:25:44 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-73370987-a149-4e86-8faf-efdc780d5f56 req-2ea4ee6c-92cc-4a10-9b70-0fec32f3b258 tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:45 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-73370987-a149-4e86-8faf-efdc780d5f56 req-2ea4ee6c-92cc-4a10-9b70-0fec32f3b258 tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:45 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-73370987-a149-4e86-8faf-efdc780d5f56 req-2ea4ee6c-92cc-4a10-9b70-0fec32f3b258 tempest-AttachVolumeTestJSON-1141657426 None] Terminate volume connection completed successfully.
Sep 24 18:25:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-73370987-a149-4e86-8faf-efdc780d5f56 req-2ea4ee6c-92cc-4a10-9b70-0fec32f3b258 tempest-AttachVolumeTestJSON-1141657426 None] Deleting attachment 943fea0c-8c2b-463a-9fb3-e42eddbc3308. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:25:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-117d4c2f-7305-4217-a818-f9bc4f4796bb" returned: 0 in 9.580s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:49 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[28eca452-09e5-4fb8-ad0b-76e4db686877]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98" returned: 0 in 1.038s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:51 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98, size 1024.00 MB, duration 9.59 sec, destination /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-117d4c2f-7305-4217-a818-f9bc4f4796bb {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:25:51 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Converted 1024.00 MB image at 106.82 MB/s
Sep 24 18:25:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-117d4c2f-7305-4217-a818-f9bc4f4796bb is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:25:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-117d4c2f-7305-4217-a818-f9bc4f4796bb {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-117d4c2f-7305-4217-a818-f9bc4f4796bb" returned: 0 in 0.265s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-117d4c2f-7305-4217-a818-f9bc4f4796bb" released by "_copy_volume_from_snapshot" :: held 12.471s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:25:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-159dbaa5-a4a5-49c7-86b1-ea5197b69546-117d4c2f-7305-4217-a818-f9bc4f4796bb" released by "_create_volume_from_snapshot" :: held 12.535s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:25:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 12.580s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:52 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e95ec4e9-a890-4405-985f-4cd5126c1f75 tempest-GroupSnapshotsTest-616484256 None] Create group from source-snapshot-b2ff6af3-42a3-4026-a930-b9a8a2635c99 completed successfully.
Sep 24 18:25:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-117d4c2f-7305-4217-a818-f9bc4f4796bb" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:25:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-117d4c2f-7305-4217-a818-f9bc4f4796bb" acquired by "delete_volume" :: waited 0.132s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:25:53 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[eda2d206-0792-4f43-8072-fda5f5d2e2e2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-117d4c2f-7305-4217-a818-f9bc4f4796bb {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-117d4c2f-7305-4217-a818-f9bc4f4796bb" returned: 0 in 1.195s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-117d4c2f-7305-4217-a818-f9bc4f4796bb {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-117d4c2f-7305-4217-a818-f9bc4f4796bb" returned: 0 in 0.169s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-117d4c2f-7305-4217-a818-f9bc4f4796bb" released by "delete_volume" :: held 1.668s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:25:55 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['7dd681fd-ade4-4f18-90e0-2f7dfd7d3a9c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:25:55 devstack cinder-volume[84177]: WARNING cinder.quota [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-459673753 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-459673753, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:25:55 devstack cinder-volume[84177]: WARNING cinder.quota [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-459673753 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-459673753, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:25:55 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['08f86065-9499-4fbd-8bc9-60c76dad2530', '4160f367-4c46-4394-9696-6635f24ab2dd', '526f4d7b-0d47-4ad9-b477-4fb8d60b5891', '2f66c89c-b945-4605-98e2-f75294f163b9'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:25:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:25:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:25:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:25:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:25:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:25:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.128s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:56 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:25:56 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-4e5e859e-a4df-4031-adce-29f96c665be1 tempest-GroupSnapshotsTest-616484256 None] Delete group completed successfully.
Sep 24 18:25:57 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] group_snapshot b2ff6af3-42a3-4026-a930-b9a8a2635c99: deleting
Sep 24 18:25:57 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:25:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] group_snapshot b2ff6af3-42a3-4026-a930-b9a8a2635c99: deleting {{(pid=84177) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 24 18:25:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-b1affc69-015f-428c-a6e4-6cb16a22da98" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:25:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-b1affc69-015f-428c-a6e4-6cb16a22da98" acquired by "delete_snapshot" :: waited 0.076s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:25:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-159dbaa5-a4a5-49c7-86b1-ea5197b69546" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:25:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-159dbaa5-a4a5-49c7-86b1-ea5197b69546" acquired by "_delete_snapshot" :: waited 0.015s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:25:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Deleting offline snapshot 159dbaa5-a4a5-49c7-86b1-ea5197b69546 of volume b1affc69-015f-428c-a6e4-6cb16a22da98 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:25:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] snapshot_file for this snap is: volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:25:58 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[52052192-f061-4c11-9bc8-c1b8148aa3fc]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546" returned: 0 in 0.700s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b1affc69-015f-428c-a6e4-6cb16a22da98(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:25:58 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f916b75f-43c7-4e6d-ba6f-83b4729c7ff2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:25:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:59 devstack quobyte-client[84204]: System call of process 92379 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:25:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98" returned: 0 in 0.461s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546" returned: 0 in 0.333s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:25:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:25:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98.159dbaa5-a4a5-49c7-86b1-ea5197b69546" returned: 0 in 0.097s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-159dbaa5-a4a5-49c7-86b1-ea5197b69546" released by "_delete_snapshot" :: held 2.001s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-b1affc69-015f-428c-a6e4-6cb16a22da98" released by "delete_snapshot" :: held 2.036s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:00 devstack cinder-volume[84177]: WARNING cinder.quota [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-459673753 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-459673753, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:26:00 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['15dccfd5-88b4-429e-817a-c1f946ebe197', 'b62de9aa-cce4-403c-b2b5-d3caacefed10', '4eb36b38-b342-4d0b-ad55-d0d46b82d74a', '292f2570-f918-4eff-9ab1-8d35aa2d2be7'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:00 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a4562272-291c-4ee7-a6b7-5875a848dd13 tempest-GroupSnapshotsTest-616484256 None] group_snapshot b2ff6af3-42a3-4026-a930-b9a8a2635c99: deleted successfully
Sep 24 18:26:02 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-b1affc69-015f-428c-a6e4-6cb16a22da98" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-b1affc69-015f-428c-a6e4-6cb16a22da98" acquired by "delete_volume" :: waited 0.124s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:02 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[631ff2e2-a9f8-4c75-b476-eeaffa4d0d5d]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:03 devstack quobyte-client[84204]: System call of process 92400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98" returned: 0 in 0.745s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b1affc69-015f-428c-a6e4-6cb16a22da98" returned: 0 in 0.208s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-b1affc69-015f-428c-a6e4-6cb16a22da98" released by "delete_volume" :: held 1.282s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "cinder-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Lock "cinder-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:04 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "cinder-quobyte-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:04 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['7a7ec108-72ec-45b1-a6fd-fed47312ec8d'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Lock "cinder-quobyte-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b" acquired by "delete_volume" :: waited 0.040s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:04 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[63803507-c9e3-4e39-ac83-3f1273c4f1ed]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:04 devstack cinder-volume[84177]: WARNING cinder.db.sqlalchemy.api [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Reservation would make usage less than 0 for the following resources, so on commit they will be limited to prevent going below 0: ['gigabytes', 'gigabytes_tempest-GroupSnapshotsTest-volume-type-459673753']
Sep 24 18:26:04 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['325446f6-9426-432a-8b70-3fb9cb9a492d', '73d99dae-cb13-47ff-9a54-4983bdfc4f8d', 'c527bebe-dcd3-4ad4-893e-4edde02cd1c2', '726edc42-60dd-4b8e-b9bf-90ee69c68904'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b" returned: 0 in 0.841s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.195s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:26:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b10bb707-9303-457a-a765-a40d86cb8f09 tempest-GroupSnapshotsTest-616484256 None] Delete group completed successfully.
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b" returned: 0 in 0.229s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Lock "cinder-quobyte-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b" released by "delete_volume" :: held 1.217s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Created reservations ['35f7c0a9-c803-4266-8297-013094fd264f', 'c039e0b9-ffa1-44fb-aeed-2ad59c7f08d7', '2b63d83a-ded9-4397-b918-3783ecae8ab4', '63c4b358-6ccd-4685-a1f4-6575bad521d7'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.120s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:06 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:26:06 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Deleted volume successfully.
Sep 24 18:26:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "cinder-b6600a39-9b61-4953-85f6-03daee5e93ff-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Lock "cinder-b6600a39-9b61-4953-85f6-03daee5e93ff-delete_volume" acquired by "delete_volume" :: waited 0.086s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c7560b98-9188-4785-937a-56dde866c247 tempest-AttachVolumeTestJSON-1141657426 None] Lock "cinder-3a1ab148-e5e4-449d-96d3-8f9c85db3b6b-delete_volume" released by "delete_volume" :: held 2.638s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:06 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "cinder-quobyte-b6600a39-9b61-4953-85f6-03daee5e93ff" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:06 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-eb92ad1f-d654-48cd-886c-c635753a888e tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:06 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-eb92ad1f-d654-48cd-886c-c635753a888e tempest-GroupSnapshotsTest-616484256 None] Group tempest-GroupSnapshotsTest-Group-1157542713: creating
Sep 24 18:26:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Lock "cinder-quobyte-b6600a39-9b61-4953-85f6-03daee5e93ff" acquired by "delete_volume" :: waited 0.057s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:07 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[33366681-0b1e-4620-bcc3-4e0b46980603]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b6600a39-9b61-4953-85f6-03daee5e93ff {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:07 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-eb92ad1f-d654-48cd-886c-c635753a888e tempest-GroupSnapshotsTest-616484256 None] Group tempest-GroupSnapshotsTest-Group-1157542713: created successfully
Sep 24 18:26:07 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-eb92ad1f-d654-48cd-886c-c635753a888e tempest-GroupSnapshotsTest-616484256 None] Create group completed successfully.
Sep 24 18:26:07 devstack quobyte-client[84204]: System call of process 92418 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b6600a39-9b61-4953-85f6-03daee5e93ff" returned: 0 in 0.616s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b6600a39-9b61-4953-85f6-03daee5e93ff {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b6600a39-9b61-4953-85f6-03daee5e93ff" returned: 0 in 0.135s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Lock "cinder-quobyte-b6600a39-9b61-4953-85f6-03daee5e93ff" released by "delete_volume" :: held 0.895s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:08 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Created reservations ['df74b65a-503f-493a-85ab-ddedc34ff8b2', 'd354367f-bac3-4b6f-a916-c9ecd427fa61', 'f615d815-4075-4ab1-92c4-b24fa3122c57', '8e2a22f2-0358-4636-bbed-6a216ae02dd5'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.229s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:08 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:26:09 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Deleted volume successfully.
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-92b12880-21d1-45c4-ad9f-2b558953ffd3 tempest-AttachVolumeTestJSON-1141657426 None] Lock "cinder-b6600a39-9b61-4953-85f6-03daee5e93ff-delete_volume" released by "delete_volume" :: held 2.398s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:09 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Flow 'volume_create_manager' (190b99c8-f6f4-46f5-a979-ead34d01552f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002e47bd-b64c-4397-ac64-8e5e4fba631a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "cinder-957aa94e-dd9d-4744-b2d8-5c1ef05710c0-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (002e47bd-b64c-4397-ac64-8e5e4fba631a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1269227625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7c3e226a-4b3a-42cd-9b06-734604c9a4a6,host='devstack@QuobyteHD#QuobyteHD',id=c9c1024c-651f-47c0-bf11-7dfc0b546d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f718a32296a94b87aba56ed4196a817c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:26:09Z,use_quota=True,user_id='0ac5c31826ea4c5a824d515218f91e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(374829ac-bf11-4548-bed0-3ace35a0d2f1),volume_type_id=374829ac-bf11-4548-bed0-3ace35a0d2f1)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6ae9e8-31d1-4962-9f28-9fcba0ecdeda) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (df6ae9e8-31d1-4962-9f28-9fcba0ecdeda) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b6f206-3f83-43fc-bd75-4e191c905beb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7b6f206-3f83-43fc-bd75-4e191c905beb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c9c1024c-651f-47c0-bf11-7dfc0b546d5b', 'volume_name': 'volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071dbcc6-8807-46cf-a561-771dd7e47528) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (071dbcc6-8807-46cf-a561-771dd7e47528) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566d423b-60db-46eb-ad6f-6f578af8bd2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:09 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Volume c9c1024c-651f-47c0-bf11-7dfc0b546d5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b', 'volume_size': 1}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7c3e226a-4b3a-42cd-9b06-734604c9a4a6,created_at=2025-09-24T16:26:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1269227625',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7c3e226a-4b3a-42cd-9b06-734604c9a4a6,host='devstack@QuobyteHD#QuobyteHD',id=c9c1024c-651f-47c0-bf11-7dfc0b546d5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f718a32296a94b87aba56ed4196a817c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:26:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:26:09Z,use_quota=True,user_id='0ac5c31826ea4c5a824d515218f91e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(374829ac-bf11-4548-bed0-3ace35a0d2f1),volume_type_id=374829ac-bf11-4548-bed0-3ace35a0d2f1)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Creating volume c9c1024c-651f-47c0-bf11-7dfc0b546d5b {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:26:09 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:09 devstack quobyte-client[84204]: System call of process 92424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:09 devstack quobyte-client[84204]: System call of process 92424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:09 devstack quobyte-client[84204]: System call of process 92424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:09 devstack quobyte-client[84204]: System call of process 92424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:09 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=25, name=volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Lock "cinder-957aa94e-dd9d-4744-b2d8-5c1ef05710c0-delete_volume" acquired by "delete_volume" :: waited 0.300s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:09 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "cinder-quobyte-957aa94e-dd9d-4744-b2d8-5c1ef05710c0" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b 1073741824" returned: 0 in 0.548s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b" returned: 0 in 0.193s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] <== create_volume: return (784ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:26:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.792s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Lock "cinder-quobyte-957aa94e-dd9d-4744-b2d8-5c1ef05710c0" acquired by "delete_volume" :: waited 0.338s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:10 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[04c9fa7b-9cb4-4315-9dc4-3956248287f7]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (566d423b-60db-46eb-ad6f-6f578af8bd2d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ef1e18-2b3f-4f45-bc72-d8d5ca41ba3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:10 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Volume volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b (c9c1024c-651f-47c0-bf11-7dfc0b546d5b): created successfully
Sep 24 18:26:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (03ef1e18-2b3f-4f45-bc72-d8d5ca41ba3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Flow 'volume_create_manager' (190b99c8-f6f4-46f5-a979-ead34d01552f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:26:10 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-bc598d34-0023-43e1-8358-4351ffbfb7b9 tempest-GroupSnapshotsTest-616484256 None] Created volume successfully.
Sep 24 18:26:10 devstack quobyte-client[84204]: System call of process 92428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0" returned: 0 in 0.660s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-957aa94e-dd9d-4744-b2d8-5c1ef05710c0" returned: 0 in 0.096s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Lock "cinder-quobyte-957aa94e-dd9d-4744-b2d8-5c1ef05710c0" released by "delete_volume" :: held 0.955s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:11 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Created reservations ['0fabd98a-0129-4b41-827e-40694fcb74d1', 'ccb49d9d-ada8-41d2-83aa-fed9bbba3477', 'c970aec8-d309-4999-8da3-c1694e0f36bb', '821f598c-789b-4252-8e61-56eef9796ff5'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.039s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.619s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:26:12 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Deleted volume successfully.
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.457s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:26:12 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Flow 'volume_create_manager' (4e0599ee-9cf6-4627-9588-ca9c415e1d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe70503a-bf1e-4b77-b622-635127f2f794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fe70503a-bf1e-4b77-b622-635127f2f794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1190683066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7c3e226a-4b3a-42cd-9b06-734604c9a4a6,host='devstack@QuobyteHD#QuobyteHD',id=54f36bd7-7ac5-43b6-a145-b088e4d162e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f718a32296a94b87aba56ed4196a817c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:26:12Z,use_quota=True,user_id='0ac5c31826ea4c5a824d515218f91e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(374829ac-bf11-4548-bed0-3ace35a0d2f1),volume_type_id=374829ac-bf11-4548-bed0-3ace35a0d2f1)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e59d37-a18c-4053-9bc4-c935fecddb8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e3e59d37-a18c-4053-9bc4-c935fecddb8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44a33ef-0eb8-4344-8a56-60a4de028057) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b44a33ef-0eb8-4344-8a56-60a4de028057) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54f36bd7-7ac5-43b6-a145-b088e4d162e4', 'volume_name': 'volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50774765-3512-43a5-a750-ca2b09a816c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (50774765-3512-43a5-a750-ca2b09a816c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71f13b7-fedd-40aa-bf5e-74d0ad64fc90) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:12 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Volume 54f36bd7-7ac5-43b6-a145-b088e4d162e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4', 'volume_size': 1}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7c3e226a-4b3a-42cd-9b06-734604c9a4a6,created_at=2025-09-24T16:26:12Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1190683066',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7c3e226a-4b3a-42cd-9b06-734604c9a4a6,host='devstack@QuobyteHD#QuobyteHD',id=54f36bd7-7ac5-43b6-a145-b088e4d162e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f718a32296a94b87aba56ed4196a817c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:26:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:26:12Z,use_quota=True,user_id='0ac5c31826ea4c5a824d515218f91e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(374829ac-bf11-4548-bed0-3ace35a0d2f1),volume_type_id=374829ac-bf11-4548-bed0-3ace35a0d2f1)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Creating volume 54f36bd7-7ac5-43b6-a145-b088e4d162e4 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:26:12 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:26:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:13 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=26, name=volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:26:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-293557e9-018b-423e-b056-d26a057d87f1 tempest-AttachVolumeTestJSON-1141657426 None] Lock "cinder-957aa94e-dd9d-4744-b2d8-5c1ef05710c0-delete_volume" released by "delete_volume" :: held 3.577s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 1073741824" returned: 0 in 0.510s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4" returned: 0 in 0.150s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] <== create_volume: return (717ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:26:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.731s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b71f13b7-fedd-40aa-bf5e-74d0ad64fc90) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc308ec8-b832-486c-84d6-569ccd1bc121) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:13 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Volume volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 (54f36bd7-7ac5-43b6-a145-b088e4d162e4): created successfully
Sep 24 18:26:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc308ec8-b832-486c-84d6-569ccd1bc121) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Flow 'volume_create_manager' (4e0599ee-9cf6-4627-9588-ca9c415e1d9e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:26:13 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-87862dcc-230c-4e76-911c-4c973c4773f8 tempest-GroupSnapshotsTest-616484256 None] Created volume successfully.
Sep 24 18:26:14 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-227d95bb-5fa2-4e88-acc7-ab2ea24bc6eb tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:14 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-227d95bb-5fa2-4e88-acc7-ab2ea24bc6eb tempest-GroupSnapshotsTest-616484256 None] Update group completed successfully.
Sep 24 18:26:16 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-53d8cc34-c235-4518-80d4-523110ecdae3 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:16 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-53d8cc34-c235-4518-80d4-523110ecdae3 tempest-GroupSnapshotsTest-616484256 None] Update group completed successfully.
Sep 24 18:26:17 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-313b6f5c-cc58-48b3-afc2-20e2ed8bd68b tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:17 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-313b6f5c-cc58-48b3-afc2-20e2ed8bd68b tempest-GroupSnapshotsTest-616484256 None] Update group completed successfully.
Sep 24 18:26:18 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-66cc4776-82b7-4aa5-bf4c-57156e1747d3 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:18 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-66cc4776-82b7-4aa5-bf4c-57156e1747d3 tempest-GroupSnapshotsTest-616484256 None] Update group completed successfully.
Sep 24 18:26:20 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] GroupSnapshot beaa3b46-a1ec-47ba-a9a1-ea2ae92741ae: creating.
Sep 24 18:26:20 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Group snapshot beaa3b46-a1ec-47ba-a9a1-ea2ae92741ae: creating. {{(pid=84177) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 24 18:26:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Creating offline snapshot 686e0b0c-33a0-4b7d-9fd0-7ce67383009e of volume 54f36bd7-7ac5-43b6-a145-b088e4d162e4 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:26:20 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef4b5370-9ad9-445c-ba83-ce86338e3180]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:21 devstack quobyte-client[84204]: System call of process 92444 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:21 devstack quobyte-client[84204]: System call of process 92444 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4" returned: 0 in 0.716s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:21 devstack quobyte-client[84204]: System call of process 92447 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:21 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=27, name=volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:26:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e 1G" returned: 0 in 0.388s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img rebase -u -b volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img rebase -u -b volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e" returned: 0 in 0.140s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:26:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e" returned: 0 in 0.105s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:26:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e" returned: 0 in 0.245s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.info" returned: 0 in 0.320s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:23 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:26:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.info" returned: 0 in 0.382s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.210s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Creating offline snapshot a6104585-bbf8-4721-964f-a6c654e11ff4 of volume c9c1024c-651f-47c0-bf11-7dfc0b546d5b {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:26:24 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a994d99-4c0d-4b60-8d88-ba097c1e138c]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:25 devstack quobyte-client[84204]: System call of process 92489 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b" returned: 0 in 1.088s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:25 devstack quobyte-client[84204]: System call of process 92498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:26 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=29, name=volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:26:26 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=61,cinder:UPDATE=71,cinder:DELETE=4,cinder:INSERT=13 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:26:26 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=76,cinder:UPDATE=63,cinder:INSERT=13,cinder:DELETE=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:26:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4 1G" returned: 0 in 0.912s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img rebase -u -b volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:26 devstack quobyte-client[84204]: System call of process 92505 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:27 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Flow 'volume_create_manager' (c33d51a2-6cba-4b10-a9bb-5695ad78b143) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86dee8de-5faa-48d3-b8fb-d4bebf228f7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (86dee8de-5faa-48d3-b8fb-d4bebf228f7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1641121088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19d8c03-9513-4009-8151-0a5544101fca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f4ca42b40b04f07a905c8dcda3e8cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:26:26Z,use_quota=True,user_id='02420222f27547d090ecace6f24192b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aecc0cb-5c3a-4396-99f4-b323f199a6fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1aecc0cb-5c3a-4396-99f4-b323f199a6fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (586e46d8-dd96-4ef3-8c59-cd0acefd969d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (586e46d8-dd96-4ef3-8c59-cd0acefd969d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd19d8c03-9513-4009-8151-0a5544101fca', 'volume_name': 'volume-d19d8c03-9513-4009-8151-0a5544101fca', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c695cc2-9f21-4b76-ad1d-cbf88123639f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6c695cc2-9f21-4b76-ad1d-cbf88123639f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a700c7d-03d6-4c5f-89ea-8a005a4f2a27) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:27 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Volume d19d8c03-9513-4009-8151-0a5544101fca: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d19d8c03-9513-4009-8151-0a5544101fca', 'volume_size': 1}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img rebase -u -b volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4" returned: 0 in 1.281s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:26:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4" returned: 0 in 0.436s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:26:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4" returned: 0 in 0.394s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.info" returned: 0 in 0.137s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.info" returned: 0 in 0.168s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 5.291s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.532s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:26:25Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesGetTestJSON-Volume-1641121088',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d19d8c03-9513-4009-8151-0a5544101fca,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='6f4ca42b40b04f07a905c8dcda3e8cf4',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:26:26Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:26:26Z,use_quota=True,user_id='02420222f27547d090ecace6f24192b5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Creating volume d19d8c03-9513-4009-8151-0a5544101fca {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:26:29 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d19d8c03-9513-4009-8151-0a5544101fca 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:29 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=31, name=volume-d19d8c03-9513-4009-8151-0a5544101fca, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d19d8c03-9513-4009-8151-0a5544101fca 1073741824" returned: 0 in 0.383s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d19d8c03-9513-4009-8151-0a5544101fca {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d19d8c03-9513-4009-8151-0a5544101fca" returned: 0 in 0.086s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] <== create_volume: return (533ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:26:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.562s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7a700c7d-03d6-4c5f-89ea-8a005a4f2a27) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d19d8c03-9513-4009-8151-0a5544101fca', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2611fb1f-c453-4272-9163-4bbb0dc627fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:30 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Volume volume-d19d8c03-9513-4009-8151-0a5544101fca (d19d8c03-9513-4009-8151-0a5544101fca): created successfully
Sep 24 18:26:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2611fb1f-c453-4272-9163-4bbb0dc627fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Flow 'volume_create_manager' (c33d51a2-6cba-4b10-a9bb-5695ad78b143) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:26:30 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-94fb82f1-b59e-4725-b527-ec2ef086ba8f req-45a5b7a3-d677-4506-a3dc-2d1340af9845 tempest-VolumesGetTestJSON-782968002 None] Created volume successfully.
Sep 24 18:26:30 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-fad1a820-ad1b-4f57-9e2f-4faa68a94e95 tempest-GroupSnapshotsTest-616484256 None] group_snapshot beaa3b46-a1ec-47ba-a9a1-ea2ae92741ae: created successfully
Sep 24 18:26:30 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Acquiring lock "cinder-d19d8c03-9513-4009-8151-0a5544101fca-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Lock "cinder-d19d8c03-9513-4009-8151-0a5544101fca-delete_volume" acquired by "delete_volume" :: waited 0.074s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:31 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Acquiring lock "cinder-quobyte-d19d8c03-9513-4009-8151-0a5544101fca" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Lock "cinder-quobyte-d19d8c03-9513-4009-8151-0a5544101fca" acquired by "delete_volume" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:31 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[eb92f5c6-bc06-4c59-a7e1-b529d2f963bb]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d19d8c03-9513-4009-8151-0a5544101fca {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:31 devstack quobyte-client[84204]: System call of process 92529 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:31 devstack quobyte-client[84204]: System call of process 92529 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:31 devstack quobyte-client[84204]: System call of process 92529 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:31 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] group_snapshot beaa3b46-a1ec-47ba-a9a1-ea2ae92741ae: deleting
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d19d8c03-9513-4009-8151-0a5544101fca" returned: 0 in 0.838s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d19d8c03-9513-4009-8151-0a5544101fca {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:32 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] group_snapshot beaa3b46-a1ec-47ba-a9a1-ea2ae92741ae: deleting {{(pid=84177) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d19d8c03-9513-4009-8151-0a5544101fca" returned: 0 in 0.346s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Lock "cinder-quobyte-d19d8c03-9513-4009-8151-0a5544101fca" released by "delete_volume" :: held 1.380s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-54f36bd7-7ac5-43b6-a145-b088e4d162e4" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-54f36bd7-7ac5-43b6-a145-b088e4d162e4" acquired by "delete_snapshot" :: waited 0.066s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-686e0b0c-33a0-4b7d-9fd0-7ce67383009e" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-686e0b0c-33a0-4b7d-9fd0-7ce67383009e" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Deleting offline snapshot 686e0b0c-33a0-4b7d-9fd0-7ce67383009e of volume 54f36bd7-7ac5-43b6-a145-b088e4d162e4 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] snapshot_file for this snap is: volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG cinder.quota [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Created reservations ['419ed672-53d2-484b-b998-6c9f43ab2e4e', '225409b7-0ecf-4059-b46d-4c2b8b509507', 'ed0a3aa7-8bb5-4b1e-a472-394a679c396d', '8a95bab4-5b26-44e0-aec5-51d53f7c7ee1'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[46ea20a4-808c-4f65-a6f7-a39197858aab]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:33 devstack quobyte-client[84204]: System call of process 92535 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.176s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG cinder.manager [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e" returned: 0 in 0.848s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:26:33 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Deleted volume successfully.
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[cae22a9b-6bb8-4522-95fc-6363143e9177]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:33 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-8fa57dc5-dc06-438e-ae21-ce29a9be9123 req-f5dec4ad-9ca4-4b16-a3a3-23ea53254c82 tempest-VolumesGetTestJSON-782968002 None] Lock "cinder-d19d8c03-9513-4009-8151-0a5544101fca-delete_volume" released by "delete_volume" :: held 2.913s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:34 devstack quobyte-client[84204]: System call of process 92539 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4" returned: 0 in 0.650s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:34 devstack quobyte-client[84204]: System call of process 92542 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:34 devstack quobyte-client[84204]: System call of process 92542 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:34 devstack quobyte-client[84204]: System call of process 92542 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:34 devstack quobyte-client[84204]: System call of process 92542 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e" returned: 0 in 0.273s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4.686e0b0c-33a0-4b7d-9fd0-7ce67383009e" returned: 0 in 0.104s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-686e0b0c-33a0-4b7d-9fd0-7ce67383009e" released by "_delete_snapshot" :: held 2.265s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-54f36bd7-7ac5-43b6-a145-b088e4d162e4" released by "delete_snapshot" :: held 2.293s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-c9c1024c-651f-47c0-bf11-7dfc0b546d5b" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-c9c1024c-651f-47c0-bf11-7dfc0b546d5b" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-a6104585-bbf8-4721-964f-a6c654e11ff4" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-a6104585-bbf8-4721-964f-a6c654e11ff4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Deleting offline snapshot a6104585-bbf8-4721-964f-a6c654e11ff4 of volume c9c1024c-651f-47c0-bf11-7dfc0b546d5b {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:26:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] snapshot_file for this snap is: volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:26:35 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c53f8229-3c1a-4028-aaee-698026c40087]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:35 devstack quobyte-client[84204]: System call of process 92546 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:35 devstack quobyte-client[84204]: System call of process 92546 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:35 devstack quobyte-client[84204]: System call of process 92546 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4" returned: 0 in 0.589s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:26:35 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ce5c382-bb4a-4ad6-a1a5-ce11872cdcce]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:36 devstack quobyte-client[84204]: System call of process 92552 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b" returned: 0 in 0.545s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:36 devstack quobyte-client[84204]: System call of process 92556 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4" returned: 0 in 0.258s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b.a6104585-bbf8-4721-964f-a6c654e11ff4" returned: 0 in 0.172s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:37 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-a6104585-bbf8-4721-964f-a6c654e11ff4" released by "_delete_snapshot" :: held 2.026s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:37 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-c9c1024c-651f-47c0-bf11-7dfc0b546d5b" released by "delete_snapshot" :: held 2.062s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:38 devstack cinder-volume[84177]: WARNING cinder.quota [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-175088355 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-175088355, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:26:38 devstack cinder-volume[84177]: WARNING cinder.quota [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-175088355 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-175088355, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:26:38 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['918de803-eff4-4725-a9d8-998661a3f9e5', 'a39e6ef3-07cb-4292-9004-c42f1cc63890', '752ecdf7-ecd9-4385-99c0-1a7290dfc12b', '9378230b-2752-4929-9c34-750f2c494a18'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:38 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['382558dc-3fd9-4bb6-9c8c-1a379b874bfe', 'be175369-7318-4fb5-b821-59db39a4a79f', '81cc447c-de43-4499-86dd-7faccf37f302', 'e754fce8-a5e2-4d16-8d8d-2386852332ad'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:38 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-52822c34-2d28-4f52-8c2b-41ed040de0f5 tempest-GroupSnapshotsTest-616484256 None] group_snapshot beaa3b46-a1ec-47ba-a9a1-ea2ae92741ae: deleted successfully
Sep 24 18:26:38 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:38 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-54f36bd7-7ac5-43b6-a145-b088e4d162e4" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:38 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-54f36bd7-7ac5-43b6-a145-b088e4d162e4" acquired by "delete_volume" :: waited 0.027s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:38 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[daa3ce7b-8560-41c3-b481-e9b91dabad1e]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:39 devstack quobyte-client[84204]: System call of process 92593 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:39 devstack quobyte-client[84204]: System call of process 92593 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:39 devstack quobyte-client[84204]: System call of process 92593 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:39 devstack quobyte-client[84204]: System call of process 92593 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4" returned: 0 in 0.516s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54f36bd7-7ac5-43b6-a145-b088e4d162e4" returned: 0 in 0.115s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-54f36bd7-7ac5-43b6-a145-b088e4d162e4" released by "delete_volume" :: held 0.808s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-c9c1024c-651f-47c0-bf11-7dfc0b546d5b" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-c9c1024c-651f-47c0-bf11-7dfc0b546d5b" acquired by "delete_volume" :: waited 0.028s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:39 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d7b5bc36-ae6a-48f6-b712-c15a1160b095]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:40 devstack quobyte-client[84204]: System call of process 92597 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b" returned: 0 in 0.546s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c9c1024c-651f-47c0-bf11-7dfc0b546d5b" returned: 0 in 0.117s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:40 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-c9c1024c-651f-47c0-bf11-7dfc0b546d5b" released by "delete_volume" :: held 0.895s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:41 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['5fcf89f8-e249-4879-a890-159921bef59a'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:41 devstack cinder-volume[84177]: WARNING cinder.quota [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-175088355 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-175088355, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:26:41 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['b426ac30-9aa6-4f3e-bef7-35916cf47221', '327b60ac-daf9-49b0-956d-28b4d0c71bcb', '365bc8ec-a6a2-4002-b451-19412533a1d6', '4fdf354f-af44-4a2b-b8db-05d2a163c878'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:41 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['231e3894-9dde-48ac-ab24-2d0ab24e42fe', '9dd3db7c-ce61-4ed1-817f-f23a0d5d2069', 'a54080e1-5b9d-4af8-8995-66279ad31e00', '4fa63adc-4a30-4a03-ab6a-53f177dfe260'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:41 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:41 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.099s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:41 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:26:41 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-75fdd3c5-a73e-4185-bd01-01dabe6cfa97 tempest-GroupSnapshotsTest-616484256 None] Delete group completed successfully.
Sep 24 18:26:43 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a76e7fdb-5ed1-42ea-9097-cdb029ff963a tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:43 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a76e7fdb-5ed1-42ea-9097-cdb029ff963a tempest-GroupSnapshotsTest-616484256 None] Group tempest-GroupSnapshotsTest-Group-1151602248: creating
Sep 24 18:26:43 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a76e7fdb-5ed1-42ea-9097-cdb029ff963a tempest-GroupSnapshotsTest-616484256 None] Group tempest-GroupSnapshotsTest-Group-1151602248: created successfully
Sep 24 18:26:43 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a76e7fdb-5ed1-42ea-9097-cdb029ff963a tempest-GroupSnapshotsTest-616484256 None] Create group completed successfully.
Sep 24 18:26:44 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:44 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:26:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Flow 'volume_create_manager' (059d4e82-bef4-42c4-9e58-a054f4a49499) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:26:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8131ac0-5cb0-45a2-9711-300037270e82) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a8131ac0-5cb0-45a2-9711-300037270e82) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-540838533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5f57822c-ffe0-47c6-8528-27a9199205f2,host='devstack@QuobyteHD#QuobyteHD',id=54461882-7b93-4f82-8f7f-3fbc739d3115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f718a32296a94b87aba56ed4196a817c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:26:45Z,use_quota=True,user_id='0ac5c31826ea4c5a824d515218f91e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9164ec9-b68e-4672-a483-7aea99ce9c8b),volume_type_id=b9164ec9-b68e-4672-a483-7aea99ce9c8b)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324c334c-1349-44fd-9e76-d1ae12ce8283) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (324c334c-1349-44fd-9e76-d1ae12ce8283) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe63ba6-c02d-4c98-8feb-aaf30b613bf4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abe63ba6-c02d-4c98-8feb-aaf30b613bf4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '54461882-7b93-4f82-8f7f-3fbc739d3115', 'volume_name': 'volume-54461882-7b93-4f82-8f7f-3fbc739d3115', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48bb8460-fb0f-406e-b82f-10e1ffb63812) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48bb8460-fb0f-406e-b82f-10e1ffb63812) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3290bd2e-3a4e-4157-b002-a8d9c57e0dfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:45 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Volume 54461882-7b93-4f82-8f7f-3fbc739d3115: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-54461882-7b93-4f82-8f7f-3fbc739d3115', 'volume_size': 1}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=5f57822c-ffe0-47c6-8528-27a9199205f2,created_at=2025-09-24T16:26:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-540838533',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=5f57822c-ffe0-47c6-8528-27a9199205f2,host='devstack@QuobyteHD#QuobyteHD',id=54461882-7b93-4f82-8f7f-3fbc739d3115,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f718a32296a94b87aba56ed4196a817c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:26:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:26:45Z,use_quota=True,user_id='0ac5c31826ea4c5a824d515218f91e17',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(b9164ec9-b68e-4672-a483-7aea99ce9c8b),volume_type_id=b9164ec9-b68e-4672-a483-7aea99ce9c8b)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Creating volume 54461882-7b93-4f82-8f7f-3fbc739d3115 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:26:45 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:45 devstack quobyte-client[84204]: System call of process 92610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:45 devstack quobyte-client[84204]: System call of process 92610 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:45 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=32, name=volume-54461882-7b93-4f82-8f7f-3fbc739d3115, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115 1073741824" returned: 0 in 0.445s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115" returned: 0 in 0.185s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] <== create_volume: return (716ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:26:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.729s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3290bd2e-3a4e-4157-b002-a8d9c57e0dfb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-54461882-7b93-4f82-8f7f-3fbc739d3115', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c432e8ab-4598-4989-a50a-dc8cc9419573) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:46 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Volume volume-54461882-7b93-4f82-8f7f-3fbc739d3115 (54461882-7b93-4f82-8f7f-3fbc739d3115): created successfully
Sep 24 18:26:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c432e8ab-4598-4989-a50a-dc8cc9419573) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Flow 'volume_create_manager' (059d4e82-bef4-42c4-9e58-a054f4a49499) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:26:46 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-f9337e21-0109-42b0-a9cf-68de64d57c8b tempest-GroupSnapshotsTest-616484256 None] Created volume successfully.
Sep 24 18:26:47 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] GroupSnapshot 702321ef-28c7-4a8e-8e4a-cdeab42411dc: creating.
Sep 24 18:26:47 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Group snapshot 702321ef-28c7-4a8e-8e4a-cdeab42411dc: creating. {{(pid=84177) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 24 18:26:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Creating offline snapshot 3adcb7e8-2e13-48e9-af74-24a15d7972bf of volume 54461882-7b93-4f82-8f7f-3fbc739d3115 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:26:47 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[afc5273a-1e53-467b-a0a2-579458132cf9]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:48 devstack quobyte-client[84204]: System call of process 92614 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115" returned: 0 in 0.464s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:48 devstack quobyte-client[84204]: System call of process 92617 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:48 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=33, name=volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:26:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf 1G" returned: 0 in 0.303s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img rebase -u -b volume-54461882-7b93-4f82-8f7f-3fbc739d3115 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:48 devstack quobyte-client[84204]: System call of process 92621 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:48 devstack quobyte-client[84204]: System call of process 92621 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:48 devstack quobyte-client[84204]: System call of process 92621 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img rebase -u -b volume-54461882-7b93-4f82-8f7f-3fbc739d3115 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf" returned: 0 in 0.169s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:48 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:26:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf" returned: 0 in 0.147s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:48 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:26:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf" returned: 0 in 0.104s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.info" returned: 0 in 0.103s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:26:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.info" returned: 0 in 0.114s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.801s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:49 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-7f58f605-27d2-4d15-91fa-cc3aece2dc8b tempest-GroupSnapshotsTest-616484256 None] group_snapshot 702321ef-28c7-4a8e-8e4a-cdeab42411dc: created successfully
Sep 24 18:26:50 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] group_snapshot 702321ef-28c7-4a8e-8e4a-cdeab42411dc: deleting
Sep 24 18:26:51 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] group_snapshot 702321ef-28c7-4a8e-8e4a-cdeab42411dc: deleting {{(pid=84177) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-54461882-7b93-4f82-8f7f-3fbc739d3115" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-54461882-7b93-4f82-8f7f-3fbc739d3115" acquired by "delete_snapshot" :: waited 0.059s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-3adcb7e8-2e13-48e9-af74-24a15d7972bf" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-3adcb7e8-2e13-48e9-af74-24a15d7972bf" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Deleting offline snapshot 3adcb7e8-2e13-48e9-af74-24a15d7972bf of volume 54461882-7b93-4f82-8f7f-3fbc739d3115 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] snapshot_file for this snap is: volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceeb9cdb-b876-4d4f-8f78-e91c8d3f73f4]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf" returned: 0 in 0.445s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-54461882-7b93-4f82-8f7f-3fbc739d3115(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec6b2f81-dbaf-4bcf-8ffa-f2705324f194]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115" returned: 0 in 0.456s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:52 devstack quobyte-client[84204]: System call of process 92634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:52 devstack quobyte-client[84204]: System call of process 92634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf" returned: 0 in 0.263s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115.3adcb7e8-2e13-48e9-af74-24a15d7972bf" returned: 0 in 0.093s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-3adcb7e8-2e13-48e9-af74-24a15d7972bf" released by "_delete_snapshot" :: held 1.578s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-54461882-7b93-4f82-8f7f-3fbc739d3115" released by "delete_snapshot" :: held 1.604s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:53 devstack cinder-volume[84177]: WARNING cinder.quota [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsTest-volume-type-790467011 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsTest-volume-type-790467011, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:26:53 devstack cinder-volume[84177]: WARNING cinder.quota [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsTest-volume-type-790467011 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsTest-volume-type-790467011, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:26:53 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['8b4e585f-f103-48bb-92b6-9c3fd606c3ef', '60ee46d9-b435-4cfd-a5a8-fce12818fdf7', 'd1da863b-b972-41b2-981a-1d2e1800b5a9', '6e5ae715-a043-4317-8e6b-43fb9840adff'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:53 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a75e3d51-5fb4-4d77-8475-56d6f0e9f978 tempest-GroupSnapshotsTest-616484256 None] group_snapshot 702321ef-28c7-4a8e-8e4a-cdeab42411dc: deleted successfully
Sep 24 18:26:54 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:54 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "cinder-quobyte-54461882-7b93-4f82-8f7f-3fbc739d3115" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:54 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-54461882-7b93-4f82-8f7f-3fbc739d3115" acquired by "delete_volume" :: waited 0.030s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:26:54 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[918131a5-c576-41be-b33d-96a6141ca026]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:26:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:55 devstack quobyte-client[84204]: System call of process 92638 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115" returned: 0 in 0.486s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-54461882-7b93-4f82-8f7f-3fbc739d3115" returned: 0 in 0.105s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Lock "cinder-quobyte-54461882-7b93-4f82-8f7f-3fbc739d3115" released by "delete_volume" :: held 0.784s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:26:55 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['82438e22-3a1c-452c-bad8-685271203bb2'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:55 devstack cinder-volume[84177]: WARNING cinder.quota [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsTest-volume-type-790467011 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsTest-volume-type-790467011, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:26:56 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Created reservations ['2e5c9287-6c03-4230-b9d4-41c2991d5ccf', 'f3fb59a3-cdcc-4a11-8279-a40382e1fc0d', 'ff7a6234-c5f6-4bf3-8fa7-f166494ed20f', '9dc42d01-05b9-4955-aa97-ffa086a34e4c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:26:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.105s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:56 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:26:56 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-af89a029-dda5-47f1-b1aa-08a8b0354fe8 tempest-GroupSnapshotsTest-616484256 None] Delete group completed successfully.
Sep 24 18:26:56 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-987c3221-01a9-4509-94f7-a97c0de74207 req-9f50564c-1e93-4881-89d1-a1eb29eeb7a3 tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:57 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-987c3221-01a9-4509-94f7-a97c0de74207 req-9f50564c-1e93-4881-89d1-a1eb29eeb7a3 tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:57 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-987c3221-01a9-4509-94f7-a97c0de74207 req-9f50564c-1e93-4881-89d1-a1eb29eeb7a3 tempest-AttachVolumeNegativeTest-1266788567 None] Terminate volume connection completed successfully.
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-987c3221-01a9-4509-94f7-a97c0de74207 req-9f50564c-1e93-4881-89d1-a1eb29eeb7a3 tempest-AttachVolumeNegativeTest-1266788567 None] Deleting attachment b554820c-d1fa-49f3-bfa4-46f5c2a37fe3. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:26:57 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Flow 'volume_create_manager' (c492c9d5-aa8c-4b1b-b7ee-978a6c62ccfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bccb52-bf3a-4a32-85b1-6639890455bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (15bccb52-bf3a-4a32-85b1-6639890455bf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2095651448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e94ac18-0026-4697-b845-b6de891832a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023a0685591e4a1a86d3daaf7a32641b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:26:57Z,use_quota=True,user_id='62810743af4947929dd525c171195af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3f7e5b-d231-47d5-9d8d-1d6e04d6da5f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c3f7e5b-d231-47d5-9d8d-1d6e04d6da5f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f0ca2e-e526-4923-8825-4b564a58b0f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (85f0ca2e-e526-4923-8825-4b564a58b0f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3e94ac18-0026-4697-b845-b6de891832a7', 'volume_name': 'volume-3e94ac18-0026-4697-b845-b6de891832a7', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6f0285-ef4b-4905-88e9-ea436c31a5d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6f0285-ef4b-4905-88e9-ea436c31a5d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146ed077-ba7b-42b3-a342-610f142ffe83) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:57 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Volume 3e94ac18-0026-4697-b845-b6de891832a7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3e94ac18-0026-4697-b845-b6de891832a7', 'volume_size': 1}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:26:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-2095651448',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3e94ac18-0026-4697-b845-b6de891832a7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023a0685591e4a1a86d3daaf7a32641b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:26:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:26:57Z,use_quota=True,user_id='62810743af4947929dd525c171195af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Creating volume 3e94ac18-0026-4697-b845-b6de891832a7 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:26:57 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:26:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3e94ac18-0026-4697-b845-b6de891832a7 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:57 devstack quobyte-client[84204]: System call of process 92645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:57 devstack quobyte-client[84204]: System call of process 92645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:57 devstack quobyte-client[84204]: System call of process 92645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:57 devstack quobyte-client[84204]: System call of process 92645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:26:57 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=35, name=volume-3e94ac18-0026-4697-b845-b6de891832a7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:26:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3e94ac18-0026-4697-b845-b6de891832a7 1073741824" returned: 0 in 0.374s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3e94ac18-0026-4697-b845-b6de891832a7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:26:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3e94ac18-0026-4697-b845-b6de891832a7" returned: 0 in 0.139s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:26:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] <== create_volume: return (590ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:26:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.620s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:26:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (146ed077-ba7b-42b3-a342-610f142ffe83) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3e94ac18-0026-4697-b845-b6de891832a7', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8d7e86-69ce-47c3-8643-1b9a58122058) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:26:58 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Volume volume-3e94ac18-0026-4697-b845-b6de891832a7 (3e94ac18-0026-4697-b845-b6de891832a7): created successfully
Sep 24 18:26:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8f8d7e86-69ce-47c3-8643-1b9a58122058) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:26:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Flow 'volume_create_manager' (c492c9d5-aa8c-4b1b-b7ee-978a6c62ccfe) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:26:58 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-18e18084-ab0d-408c-b4e5-238c2c87dd80 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Created volume successfully.
Sep 24 18:26:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Acquiring lock "cinder-3e94ac18-0026-4697-b845-b6de891832a7-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:26:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "cinder-3e94ac18-0026-4697-b845-b6de891832a7-delete_volume" acquired by "delete_volume" :: waited 0.063s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:27:00 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Acquiring lock "cinder-quobyte-3e94ac18-0026-4697-b845-b6de891832a7" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:27:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "cinder-quobyte-3e94ac18-0026-4697-b845-b6de891832a7" acquired by "delete_volume" :: waited 0.025s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:27:00 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8699ebb3-4ae7-4055-87ca-ab3f86ca0f7f]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3e94ac18-0026-4697-b845-b6de891832a7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:01 devstack quobyte-client[84204]: System call of process 92670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:01 devstack quobyte-client[84204]: System call of process 92670 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3e94ac18-0026-4697-b845-b6de891832a7" returned: 0 in 1.202s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3e94ac18-0026-4697-b845-b6de891832a7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3e94ac18-0026-4697-b845-b6de891832a7" returned: 0 in 0.121s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "cinder-quobyte-3e94ac18-0026-4697-b845-b6de891832a7" released by "delete_volume" :: held 1.689s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:27:02 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Created reservations ['fed1434a-6823-479d-9e81-a82ed474ca5a', '9dc6fcc3-fa19-4f39-a797-3ae4a92f36fc', '74492b67-e214-4359-8c72-084f47a719ee', 'cbd60b48-ce1f-4b5a-9847-16fba38228ef'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:27:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:02 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:02 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.190s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:02 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:27:02 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Deleted volume successfully.
Sep 24 18:27:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-56622e14-ddfb-4285-877d-4bc7ab4cb502 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "cinder-3e94ac18-0026-4697-b845-b6de891832a7-delete_volume" released by "delete_volume" :: held 3.161s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:27:05 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:05 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:27:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Flow 'volume_create_manager' (0173db9d-a0bc-4101-a006-c4e7e565f16b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:27:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63533413-dab5-442d-aa3a-026bdb17cd18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (63533413-dab5-442d-aa3a-026bdb17cd18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1062906048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da39713f-a76a-42df-b673-76f3e85f7292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023a0685591e4a1a86d3daaf7a32641b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:27:05Z,use_quota=True,user_id='62810743af4947929dd525c171195af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6082bf-6861-4cb0-9bc3-171af237bc6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b6082bf-6861-4cb0-9bc3-171af237bc6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bd59b8-4f97-4f1f-92d2-4c08975e5eb1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a0bd59b8-4f97-4f1f-92d2-4c08975e5eb1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'da39713f-a76a-42df-b673-76f3e85f7292', 'volume_name': 'volume-da39713f-a76a-42df-b673-76f3e85f7292', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d883509f-87f9-4fd8-811e-1af4e9756a78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d883509f-87f9-4fd8-811e-1af4e9756a78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6325e28-2cb5-43c3-a10b-953cfb7dc583) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:06 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Volume da39713f-a76a-42df-b673-76f3e85f7292: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-da39713f-a76a-42df-b673-76f3e85f7292', 'volume_size': 1}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:27:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasAdminTestJSON-Volume-1062906048',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=da39713f-a76a-42df-b673-76f3e85f7292,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='023a0685591e4a1a86d3daaf7a32641b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:27:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:27:05Z,use_quota=True,user_id='62810743af4947929dd525c171195af9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Creating volume da39713f-a76a-42df-b673-76f3e85f7292 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:27:06 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-da39713f-a76a-42df-b673-76f3e85f7292 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:06 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=36, name=volume-da39713f-a76a-42df-b673-76f3e85f7292, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-da39713f-a76a-42df-b673-76f3e85f7292 1073741824" returned: 0 in 0.360s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-da39713f-a76a-42df-b673-76f3e85f7292 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-da39713f-a76a-42df-b673-76f3e85f7292" returned: 0 in 0.101s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] <== create_volume: return (535ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:27:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.550s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6325e28-2cb5-43c3-a10b-953cfb7dc583) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-da39713f-a76a-42df-b673-76f3e85f7292', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b09987-2c80-4e34-9448-c21139726943) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:07 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Volume volume-da39713f-a76a-42df-b673-76f3e85f7292 (da39713f-a76a-42df-b673-76f3e85f7292): created successfully
Sep 24 18:27:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a5b09987-2c80-4e34-9448-c21139726943) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Flow 'volume_create_manager' (0173db9d-a0bc-4101-a006-c4e7e565f16b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:27:07 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-4fa4ca42-f0c3-4de5-aee9-b2ea23c19873 tempest-VolumeQuotasAdminTestJSON-1629550439 None] Created volume successfully.
Sep 24 18:27:09 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-950be5ee-c4c5-4a8b-9cf6-220572755b2d tempest-GroupSnapshotsV319Test-1376894699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:09 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-950be5ee-c4c5-4a8b-9cf6-220572755b2d tempest-GroupSnapshotsV319Test-1376894699 None] Group tempest-GroupSnapshotsV319Test-Group-898433127: creating
Sep 24 18:27:09 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-950be5ee-c4c5-4a8b-9cf6-220572755b2d tempest-GroupSnapshotsV319Test-1376894699 None] Group tempest-GroupSnapshotsV319Test-Group-898433127: created successfully
Sep 24 18:27:09 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-950be5ee-c4c5-4a8b-9cf6-220572755b2d tempest-GroupSnapshotsV319Test-1376894699 None] Create group completed successfully.
Sep 24 18:27:09 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-7f4589c9-83cc-42b0-881a-b49ffcc8e93a tempest-VolumeQuotasAdminTestJSON-74368011 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:09 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-7f4589c9-83cc-42b0-881a-b49ffcc8e93a tempest-VolumeQuotasAdminTestJSON-74368011 None] Transfer volume completed successfully.
Sep 24 18:27:10 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Flow 'volume_create_manager' (6e9c06a3-f054-4465-87ff-67996fd9102e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500fb947-092a-476f-aa00-042d63633156) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (500fb947-092a-476f-aa00-042d63633156) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-232175898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7787c6bf-60f4-460d-be93-6d69a9e4b475,host='devstack@QuobyteHD#QuobyteHD',id=25c18206-c3d1-45da-b658-2190704d33d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe73e8c0d6f49a4afb9cc1eda8da0a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:27:11Z,use_quota=True,user_id='dac8e06206244633b221be2baa4f236f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f043f579-46a4-4e64-a1c2-b10d57b53196),volume_type_id=f043f579-46a4-4e64-a1c2-b10d57b53196)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff098a7-7a2f-40ac-a9fd-9c200d89fc6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0ff098a7-7a2f-40ac-a9fd-9c200d89fc6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5fa0dc-2767-4df9-aaf7-bec0c69fe55e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b5fa0dc-2767-4df9-aaf7-bec0c69fe55e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '25c18206-c3d1-45da-b658-2190704d33d2', 'volume_name': 'volume-25c18206-c3d1-45da-b658-2190704d33d2', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06decd6-782f-45ee-b2cd-85f3c090a9f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a06decd6-782f-45ee-b2cd-85f3c090a9f8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e32a64d-f9aa-4e81-bf24-0fae339e8593) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:11 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Volume 25c18206-c3d1-45da-b658-2190704d33d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-25c18206-c3d1-45da-b658-2190704d33d2', 'volume_size': 1}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=7787c6bf-60f4-460d-be93-6d69a9e4b475,created_at=2025-09-24T16:27:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-232175898',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=7787c6bf-60f4-460d-be93-6d69a9e4b475,host='devstack@QuobyteHD#QuobyteHD',id=25c18206-c3d1-45da-b658-2190704d33d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='6fe73e8c0d6f49a4afb9cc1eda8da0a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:27:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:27:11Z,use_quota=True,user_id='dac8e06206244633b221be2baa4f236f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(f043f579-46a4-4e64-a1c2-b10d57b53196),volume_type_id=f043f579-46a4-4e64-a1c2-b10d57b53196)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Creating volume 25c18206-c3d1-45da-b658-2190704d33d2 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:27:11 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:11 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=37, name=volume-25c18206-c3d1-45da-b658-2190704d33d2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Acquiring lock "cinder-da39713f-a76a-42df-b673-76f3e85f7292-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Lock "cinder-da39713f-a76a-42df-b673-76f3e85f7292-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2 1073741824" returned: 0 in 0.668s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2" returned: 0 in 0.698s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] <== create_volume: return (1426ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.439s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.429s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1e32a64d-f9aa-4e81-bf24-0fae339e8593) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-25c18206-c3d1-45da-b658-2190704d33d2', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c595d7-4fd6-41b7-a826-850758017d09) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:12 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Acquiring lock "cinder-quobyte-da39713f-a76a-42df-b673-76f3e85f7292" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Lock "cinder-quobyte-da39713f-a76a-42df-b673-76f3e85f7292" acquired by "delete_volume" :: waited 0.045s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:27:12 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Volume volume-25c18206-c3d1-45da-b658-2190704d33d2 (25c18206-c3d1-45da-b658-2190704d33d2): created successfully
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (55c595d7-4fd6-41b7-a826-850758017d09) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Flow 'volume_create_manager' (6e9c06a3-f054-4465-87ff-67996fd9102e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f037d048-03c9-4bb0-a36f-dc8e021556d2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-da39713f-a76a-42df-b673-76f3e85f7292 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:13 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-98fded05-4625-4324-84e9-5b19293600c3 tempest-GroupSnapshotsV319Test-1376894699 None] Created volume successfully.
Sep 24 18:27:13 devstack quobyte-client[84204]: System call of process 92716 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-da39713f-a76a-42df-b673-76f3e85f7292" returned: 0 in 0.607s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-da39713f-a76a-42df-b673-76f3e85f7292 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-da39713f-a76a-42df-b673-76f3e85f7292" returned: 0 in 0.132s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:13 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] GroupSnapshot 274c1b75-bc50-42cc-933e-1bd57f592247: creating.
Sep 24 18:27:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Lock "cinder-quobyte-da39713f-a76a-42df-b673-76f3e85f7292" released by "delete_volume" :: held 1.153s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:27:14 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Group snapshot 274c1b75-bc50-42cc-933e-1bd57f592247: creating. {{(pid=84177) create_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4142}}
Sep 24 18:27:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:14 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Created reservations ['072ee001-450b-4adb-bdd2-c8b28fde8008', 'f5f20b75-f84e-4108-9afd-57a701df768c', '7b70be48-c585-4bcf-bddf-fec7d985df7d', '8312f7ef-e094-422c-a7a7-75a5b47f7256'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:27:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Creating offline snapshot e5a3389f-4ab4-465a-a5c8-eba975cc15f4 of volume 25c18206-c3d1-45da-b658-2190704d33d2 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:27:14 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9094beee-d311-4e87-9106-e3a8703b7203]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.052s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.050s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:15 devstack quobyte-client[84204]: System call of process 92721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.245s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:15 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:27:15 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Deleted volume successfully.
Sep 24 18:27:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2" returned: 0 in 1.094s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:15 devstack quobyte-client[84204]: System call of process 92725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:15 devstack quobyte-client[84204]: System call of process 92725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:15 devstack quobyte-client[84204]: System call of process 92725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:15 devstack quobyte-client[84204]: System call of process 92725 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b9343eb-e252-46dc-be1b-5a07054ee0a2 tempest-VolumeQuotasAdminTestJSON-82607506 None] Lock "cinder-da39713f-a76a-42df-b673-76f3e85f7292-delete_volume" released by "delete_volume" :: held 4.203s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:27:15 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=38, name=volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4 1G" returned: 0 in 0.446s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): qemu-img rebase -u -b volume-25c18206-c3d1-45da-b658-2190704d33d2 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:16 devstack quobyte-client[84204]: System call of process 92728 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:16 devstack quobyte-client[84204]: System call of process 92728 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] CMD "qemu-img rebase -u -b volume-25c18206-c3d1-45da-b658-2190704d33d2 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4" returned: 0 in 0.166s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4" returned: 0 in 0.153s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4" returned: 0 in 0.119s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.info" returned: 0 in 0.122s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:27:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.info" returned: 0 in 0.172s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.713s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:17 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e9a63dad-57da-4fa6-bdc8-3e37208f7241 tempest-GroupSnapshotsV319Test-1376894699 None] group_snapshot 274c1b75-bc50-42cc-933e-1bd57f592247: created successfully
Sep 24 18:27:18 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] group_snapshot 274c1b75-bc50-42cc-933e-1bd57f592247: deleting
Sep 24 18:27:19 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] group_snapshot 274c1b75-bc50-42cc-933e-1bd57f592247: deleting {{(pid=84177) delete_group_snapshot /opt/stack/cinder/cinder/volume/manager.py:4317}}
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Acquiring lock "cinder-quobyte-25c18206-c3d1-45da-b658-2190704d33d2" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Lock "cinder-quobyte-25c18206-c3d1-45da-b658-2190704d33d2" acquired by "delete_snapshot" :: waited 0.068s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Acquiring lock "cinder-quobyte-e5a3389f-4ab4-465a-a5c8-eba975cc15f4" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Lock "cinder-quobyte-e5a3389f-4ab4-465a-a5c8-eba975cc15f4" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Deleting offline snapshot e5a3389f-4ab4-465a-a5c8-eba975cc15f4 of volume 25c18206-c3d1-45da-b658-2190704d33d2 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] snapshot_file for this snap is: volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbb97e3f-2772-4a49-b37d-6546810d7b67]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:19 devstack quobyte-client[84204]: System call of process 92736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:19 devstack quobyte-client[84204]: System call of process 92736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:19 devstack quobyte-client[84204]: System call of process 92736 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4" returned: 0 in 0.560s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-25c18206-c3d1-45da-b658-2190704d33d2(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4373e62f-c6de-4023-bda2-4da1d8fd5477]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:20 devstack quobyte-client[84204]: System call of process 92739 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2" returned: 0 in 0.524s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:20 devstack quobyte-client[84204]: System call of process 92742 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:20 devstack quobyte-client[84204]: System call of process 92742 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4" returned: 0 in 0.265s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2.e5a3389f-4ab4-465a-a5c8-eba975cc15f4" returned: 0 in 0.114s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Lock "cinder-quobyte-e5a3389f-4ab4-465a-a5c8-eba975cc15f4" released by "_delete_snapshot" :: held 1.923s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:27:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Lock "cinder-quobyte-25c18206-c3d1-45da-b658-2190704d33d2" released by "delete_snapshot" :: held 1.960s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:27:21 devstack cinder-volume[84177]: WARNING cinder.quota [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1210762234 is set by the default quota flag: quota_gigabytes_tempest-GroupSnapshotsV319Test-volume-type-1210762234, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:27:21 devstack cinder-volume[84177]: WARNING cinder.quota [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Deprecated: Default quota for resource: snapshots_tempest-GroupSnapshotsV319Test-volume-type-1210762234 is set by the default quota flag: quota_snapshots_tempest-GroupSnapshotsV319Test-volume-type-1210762234, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:27:21 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] Created reservations ['439a6860-93c3-466e-8f2b-3920f980f3be', '62a79fb8-02b6-4c16-a968-d1a0dd95196d', '68d8c0a6-1fdc-4322-9010-7bccb67b238f', '369360e4-e180-4734-b09d-25294d7dfbed'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:27:21 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-224e7e61-03eb-4bf6-b4d3-d0880460034b tempest-GroupSnapshotsV319Test-1376894699 None] group_snapshot 274c1b75-bc50-42cc-933e-1bd57f592247: deleted successfully
Sep 24 18:27:23 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Acquiring lock "cinder-quobyte-25c18206-c3d1-45da-b658-2190704d33d2" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:27:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Lock "cinder-quobyte-25c18206-c3d1-45da-b658-2190704d33d2" acquired by "delete_volume" :: waited 0.020s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:27:23 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d4034c05-0a19-4b16-bae0-15cd9fe052b9]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2" returned: 0 in 0.549s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-25c18206-c3d1-45da-b658-2190704d33d2" returned: 0 in 0.167s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:24 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Lock "cinder-quobyte-25c18206-c3d1-45da-b658-2190704d33d2" released by "delete_volume" :: held 0.899s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:27:24 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Created reservations ['6fb62504-71cd-46b3-9735-cf30e54baee1'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:27:25 devstack cinder-volume[84177]: WARNING cinder.quota [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Deprecated: Default quota for resource: volumes_tempest-GroupSnapshotsV319Test-volume-type-1210762234 is set by the default quota flag: quota_volumes_tempest-GroupSnapshotsV319Test-volume-type-1210762234, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:27:25 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Created reservations ['fc8a45bb-2d73-457e-a389-83efe4bd66da', '08c37512-5327-4286-b8f1-dc433ee5fea7', '9e0094b1-6555-4e87-afcc-aeeb3e06fde6', 'e8f16165-a8e6-4a9b-a2bc-79a2bb1b5f28'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:27:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.042s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.137s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:25 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:27:25 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-902c7a3c-ce82-400d-8685-01af49d86c1e tempest-GroupSnapshotsV319Test-1376894699 None] Delete group completed successfully.
Sep 24 18:27:29 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=98,cinder:SELECT=88,cinder:INSERT=14,cinder:DELETE=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:27:29 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=104,cinder:UPDATE=115,cinder:DELETE=6,cinder:INSERT=33 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:27:29 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Flow 'volume_create_manager' (b35bb0b5-0557-47e5-b945-1d42b9aeb263) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5a81b9-66c0-49ee-8812-0474962cb864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2d5a81b9-66c0-49ee-8812-0474962cb864) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-629706988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13903a2d-9379-46a1-a0e5-b560359c7fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4afd588b55498b8141bf6c0809e7ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:27:30Z,use_quota=True,user_id='845a00c61bfc4aed9fc77b2b3ca5648f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7943a1-cbf0-484b-97eb-c853ed649bca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b7943a1-cbf0-484b-97eb-c853ed649bca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82873e1-825e-4f1c-846e-c78dd0d749cb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f82873e1-825e-4f1c-846e-c78dd0d749cb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '13903a2d-9379-46a1-a0e5-b560359c7fb3', 'volume_name': 'volume-13903a2d-9379-46a1-a0e5-b560359c7fb3', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b94145-48a8-489d-93c7-016b2b27755f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a6b94145-48a8-489d-93c7-016b2b27755f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d2ab25-eebb-40de-8980-dac7dc1f8872) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:30 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Volume 13903a2d-9379-46a1-a0e5-b560359c7fb3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-13903a2d-9379-46a1-a0e5-b560359c7fb3', 'volume_size': 1}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:27:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeQuotasNegativeTestJSON-Volume-629706988',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=13903a2d-9379-46a1-a0e5-b560359c7fb3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d4afd588b55498b8141bf6c0809e7ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:27:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:27:30Z,use_quota=True,user_id='845a00c61bfc4aed9fc77b2b3ca5648f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Creating volume 13903a2d-9379-46a1-a0e5-b560359c7fb3 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:27:30 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:27:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-13903a2d-9379-46a1-a0e5-b560359c7fb3 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:30 devstack quobyte-client[84204]: System call of process 92768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:30 devstack quobyte-client[84204]: System call of process 92768 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:30 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=40, name=volume-13903a2d-9379-46a1-a0e5-b560359c7fb3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:27:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-13903a2d-9379-46a1-a0e5-b560359c7fb3 1073741824" returned: 0 in 0.522s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-13903a2d-9379-46a1-a0e5-b560359c7fb3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-13903a2d-9379-46a1-a0e5-b560359c7fb3" returned: 0 in 0.155s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] <== create_volume: return (758ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:27:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.770s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (52d2ab25-eebb-40de-8980-dac7dc1f8872) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-13903a2d-9379-46a1-a0e5-b560359c7fb3', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17204ef-3eb4-451d-9c4c-f6e7775453b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:31 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Volume volume-13903a2d-9379-46a1-a0e5-b560359c7fb3 (13903a2d-9379-46a1-a0e5-b560359c7fb3): created successfully
Sep 24 18:27:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d17204ef-3eb4-451d-9c4c-f6e7775453b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Flow 'volume_create_manager' (b35bb0b5-0557-47e5-b945-1d42b9aeb263) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:27:31 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-26afa156-189c-460b-89c4-13aa89d52401 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Created volume successfully.
Sep 24 18:27:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Acquiring lock "cinder-13903a2d-9379-46a1-a0e5-b560359c7fb3-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:27:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Lock "cinder-13903a2d-9379-46a1-a0e5-b560359c7fb3-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:27:34 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Acquiring lock "cinder-quobyte-13903a2d-9379-46a1-a0e5-b560359c7fb3" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:27:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Lock "cinder-quobyte-13903a2d-9379-46a1-a0e5-b560359c7fb3" acquired by "delete_volume" :: waited 0.016s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:27:34 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[12501b5a-b03d-41f7-a85d-b1fffb4fbb1e]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-13903a2d-9379-46a1-a0e5-b560359c7fb3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:35 devstack quobyte-client[84204]: System call of process 92778 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-13903a2d-9379-46a1-a0e5-b560359c7fb3" returned: 0 in 0.674s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-13903a2d-9379-46a1-a0e5-b560359c7fb3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-13903a2d-9379-46a1-a0e5-b560359c7fb3" returned: 0 in 0.163s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:36 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Lock "cinder-quobyte-13903a2d-9379-46a1-a0e5-b560359c7fb3" released by "delete_volume" :: held 1.256s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:27:36 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Created reservations ['eb18f0ff-fac2-4e1c-b1e3-95f61b65dff4', '75d71d7b-3aac-4a0c-90fb-a223c2f181f3', 'd326324c-4f01-4318-a815-3817fdf5daef', 'cd3779e1-b2fa-427c-b903-d1849aed23ca'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:27:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.053s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.442s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:37 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:27:37 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Deleted volume successfully.
Sep 24 18:27:37 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d7e6c537-9f4f-4134-8f98-4261a86c0972 tempest-VolumeQuotasNegativeTestJSON-1816266325 None] Lock "cinder-13903a2d-9379-46a1-a0e5-b560359c7fb3-delete_volume" released by "delete_volume" :: held 2.908s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:27:47 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=10,cinder:SELECT=7,cinder:INSERT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:27:47 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=5,cinder:UPDATE=10,cinder:DELETE=2,cinder:INSERT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:27:51 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:51 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:27:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Flow 'volume_create_manager' (d9455b47-f350-4447-958f-8a4a8430f271) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:27:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d566235-18f8-4e59-9587-43c92c9ce15a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:51 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:51 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:27:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Flow 'volume_create_manager' (b15b670b-0dcf-40ef-b393-ffd1abe1bc58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:27:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6da151e-044d-4255-bcc4-4920b93c799f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6d566235-18f8-4e59-9587-43c92c9ce15a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1457348107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1fed31-a373-466a-b9b6-ff4c17ae586a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451cd327c7284682a093bb9710d5c459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:27:51Z,use_quota=True,user_id='65e5448e90c04622b97fb7db0ea1d9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913605cd-4da5-4c2d-996c-00b44c5c7e7b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (913605cd-4da5-4c2d-996c-00b44c5c7e7b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a77b29-d758-4b3f-8dee-7e4dbaf12436) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81a77b29-d758-4b3f-8dee-7e4dbaf12436) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4e1fed31-a373-466a-b9b6-ff4c17ae586a', 'volume_name': 'volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12ed421-f750-46dd-acf5-a9959ab3684e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a12ed421-f750-46dd-acf5-a9959ab3684e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553da86f-2e06-4475-97a6-d19e35667eec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:52 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Volume 4e1fed31-a373-466a-b9b6-ff4c17ae586a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a', 'volume_size': 1}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotsActionsTest-Volume-1457348107',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4e1fed31-a373-466a-b9b6-ff4c17ae586a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='451cd327c7284682a093bb9710d5c459',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:27:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:27:51Z,use_quota=True,user_id='65e5448e90c04622b97fb7db0ea1d9e0',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Creating volume 4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:27:52 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:52 devstack quobyte-client[84204]: System call of process 92904 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:52 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=41, name=volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d6da151e-044d-4255-bcc4-4920b93c799f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-201051259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e954377-246a-44e0-b5d6-9064cea78498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80301d5b9a74d198ceb1adf2363e13b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:27:52Z,use_quota=True,user_id='b9ffe2f94dd64fd18e145949896b05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7dc41f10-9263-4207-9d6c-2aa953fb6b05),volume_type_id=7dc41f10-9263-4207-9d6c-2aa953fb6b05)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7cff66-773f-4ff8-a11f-7e07762d6f4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8e7cff66-773f-4ff8-a11f-7e07762d6f4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd8a5d6-2c86-469b-aa72-b2970506f194) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fd8a5d6-2c86-469b-aa72-b2970506f194) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0e954377-246a-44e0-b5d6-9064cea78498', 'volume_name': 'volume-0e954377-246a-44e0-b5d6-9064cea78498', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4367686b-f51e-4689-a8c6-a34f99ba9aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4367686b-f51e-4689-a8c6-a34f99ba9aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fda464d-0f72-4cdd-aeab-63407e4849a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:52 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Volume 0e954377-246a-44e0-b5d6-9064cea78498: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0e954377-246a-44e0-b5d6-9064cea78498', 'volume_size': 1}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a 1073741824" returned: 0 in 0.753s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a" returned: 0 in 0.113s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] <== create_volume: return (920ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:27:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.934s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.395s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:27:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeRetypeWithoutMigrationTest-Volume-201051259',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0e954377-246a-44e0-b5d6-9064cea78498,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f80301d5b9a74d198ceb1adf2363e13b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:27:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:27:52Z,use_quota=True,user_id='b9ffe2f94dd64fd18e145949896b05b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(7dc41f10-9263-4207-9d6c-2aa953fb6b05),volume_type_id=7dc41f10-9263-4207-9d6c-2aa953fb6b05)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Creating volume 0e954377-246a-44e0-b5d6-9064cea78498 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:27:53 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0e954377-246a-44e0-b5d6-9064cea78498 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:53 devstack quobyte-client[84204]: System call of process 92909 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:53 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=42, name=volume-0e954377-246a-44e0-b5d6-9064cea78498, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (553da86f-2e06-4475-97a6-d19e35667eec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b65a45-6c26-47bf-91d6-32823004442b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0e954377-246a-44e0-b5d6-9064cea78498 1073741824" returned: 0 in 0.646s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0e954377-246a-44e0-b5d6-9064cea78498 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:54 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Volume volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a (4e1fed31-a373-466a-b9b6-ff4c17ae586a): created successfully
Sep 24 18:27:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (88b65a45-6c26-47bf-91d6-32823004442b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Flow 'volume_create_manager' (d9455b47-f350-4447-958f-8a4a8430f271) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:27:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0e954377-246a-44e0-b5d6-9064cea78498" returned: 0 in 0.270s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] <== create_volume: return (955ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:27:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.979s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:54 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e9ce16ee-8224-4ba6-a0ee-3e703c824725 tempest-SnapshotsActionsTest-2129335768 None] Created volume successfully.
Sep 24 18:27:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2fda464d-0f72-4cdd-aeab-63407e4849a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0e954377-246a-44e0-b5d6-9064cea78498', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e0a107-c9ad-4801-afb5-3a243747b207) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:27:54 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Volume volume-0e954377-246a-44e0-b5d6-9064cea78498 (0e954377-246a-44e0-b5d6-9064cea78498): created successfully
Sep 24 18:27:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (96e0a107-c9ad-4801-afb5-3a243747b207) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:27:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Flow 'volume_create_manager' (b15b670b-0dcf-40ef-b393-ffd1abe1bc58) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:27:54 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1e1833fb-8c7c-4507-8a24-eb1e54dd34a5 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Created volume successfully.
Sep 24 18:27:55 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Creating offline snapshot 2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 of volume 4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:27:55 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1767d262-87e5-4d1a-81f5-9b1ce3bcb83e]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:55 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-2c903345-95e9-4e67-8d91-b302e32da001 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a" returned: 0 in 0.695s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:56 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=43, name=volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:27:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 1G" returned: 0 in 0.645s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:57 devstack quobyte-client[84204]: System call of process 92919 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] CMD "qemu-img rebase -u -b volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.385s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2c903345-95e9-4e67-8d91-b302e32da001 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2c903345-95e9-4e67-8d91-b302e32da001 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.030s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2c903345-95e9-4e67-8d91-b302e32da001 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2c903345-95e9-4e67-8d91-b302e32da001 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2c903345-95e9-4e67-8d91-b302e32da001 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2c903345-95e9-4e67-8d91-b302e32da001 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.371s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2c903345-95e9-4e67-8d91-b302e32da001 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.266s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-2c903345-95e9-4e67-8d91-b302e32da001 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:27:57 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-2c903345-95e9-4e67-8d91-b302e32da001 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Retype volume completed successfully.
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.259s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.info" returned: 0 in 0.138s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:27:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.info" returned: 0 in 0.131s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.955s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:27:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Acquiring lock "cinder-0e954377-246a-44e0-b5d6-9064cea78498-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:27:58 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-486f9111-72d0-436f-b39b-2e6e9e13fa3f tempest-SnapshotsActionsTest-2129335768 None] Create snapshot completed successfully
Sep 24 18:27:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Lock "cinder-0e954377-246a-44e0-b5d6-9064cea78498-delete_volume" acquired by "delete_volume" :: waited 0.104s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:27:58 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:27:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Acquiring lock "cinder-quobyte-0e954377-246a-44e0-b5d6-9064cea78498" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:27:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Lock "cinder-quobyte-0e954377-246a-44e0-b5d6-9064cea78498" acquired by "delete_volume" :: waited 0.017s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:27:58 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5746c80-c6c6-4205-9a3e-952f9a1684d1]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:27:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0e954377-246a-44e0-b5d6-9064cea78498 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:59 devstack quobyte-client[84204]: System call of process 92928 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:27:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0e954377-246a-44e0-b5d6-9064cea78498" returned: 0 in 0.469s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0e954377-246a-44e0-b5d6-9064cea78498 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:27:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0e954377-246a-44e0-b5d6-9064cea78498" returned: 0 in 0.145s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:27:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Lock "cinder-quobyte-0e954377-246a-44e0-b5d6-9064cea78498" released by "delete_volume" :: held 0.784s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:27:59 devstack cinder-volume[84177]: WARNING cinder.quota [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Deprecated: Default quota for resource: volumes_volume-type-2 is set by the default quota flag: quota_volumes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:27:59 devstack cinder-volume[84177]: WARNING cinder.quota [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Deprecated: Default quota for resource: gigabytes_volume-type-2 is set by the default quota flag: quota_gigabytes_volume-type-2, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:27:59 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Created reservations ['09c79e30-05a1-455e-9337-550f729e4ab1', '5a90e6a5-4d28-4a71-873d-0706c74dd9b4', 'e33408cb-f911-4092-9436-db12a67c785e', 'e2d4fdae-6835-41bc-a045-97d614fb8b2c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:28:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:28:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:28:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.149s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:00 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:28:00 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Deleted volume successfully.
Sep 24 18:28:01 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Creating offline snapshot 8954ed61-d554-45c5-8f45-a7e3037a8c25 of volume 4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:28:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b2f15027-5eec-4c5b-bcfb-7902ddbadbb3 tempest-VolumeRetypeWithoutMigrationTest-1981296865 None] Lock "cinder-0e954377-246a-44e0-b5d6-9064cea78498-delete_volume" released by "delete_volume" :: held 2.567s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:01 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[09a5e486-c763-429f-87ab-f986773f8721]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.650s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:02 devstack quobyte-client[84204]: System call of process 92936 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:02 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=45, name=volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:28:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25 1G" returned: 0 in 0.550s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:02 devstack quobyte-client[84204]: System call of process 92939 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] CMD "qemu-img rebase -u -b volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25" returned: 0 in 0.371s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:02 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:28:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25" returned: 0 in 0.144s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:28:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25" returned: 0 in 0.292s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.518s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:03 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-13170f24-e8d7-4015-96fe-adc11dbbf740 tempest-SnapshotsActionsTest-2129335768 None] Create snapshot completed successfully
Sep 24 18:28:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Acquiring lock "cinder-8954ed61-d554-45c5-8f45-a7e3037a8c25-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-8954ed61-d554-45c5-8f45-a7e3037a8c25-delete_snapshot" acquired by "delete_snapshot" :: waited 0.076s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:05 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Acquiring lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" acquired by "delete_snapshot" :: waited 0.029s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Acquiring lock "cinder-quobyte-8954ed61-d554-45c5-8f45-a7e3037a8c25" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-8954ed61-d554-45c5-8f45-a7e3037a8c25" acquired by "_delete_snapshot" :: waited 0.048s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Deleting offline snapshot 8954ed61-d554-45c5-8f45-a7e3037a8c25 of volume 4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:28:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] snapshot_file for this snap is: volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:28:05 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[75eff080-ee7a-451e-aa5b-710784372e67]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:05 devstack quobyte-client[84204]: System call of process 92951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:05 devstack quobyte-client[84204]: System call of process 92951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:05 devstack quobyte-client[84204]: System call of process 92951 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25" returned: 0 in 0.500s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:06 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3b8f726a-ce78-4c82-abcc-197959404e21]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:06 devstack quobyte-client[84204]: System call of process 92954 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.489s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:06 devstack quobyte-client[84204]: System call of process 92957 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25" returned: 0 in 0.379s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.8954ed61-d554-45c5-8f45-a7e3037a8c25" returned: 0 in 0.126s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-8954ed61-d554-45c5-8f45-a7e3037a8c25" released by "_delete_snapshot" :: held 1.885s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" released by "delete_snapshot" :: held 1.955s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:07 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Created reservations ['4abb7845-e72a-4b2a-8153-6589d32ee27e', 'e651b601-1c04-4d29-be36-ecf9bd7981bb', '140575a2-951a-406a-9f99-a4d024819d7b', 'b362a0dd-34ac-480b-8afc-08c4db776284'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:28:08 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Delete snapshot completed successfully.
Sep 24 18:28:08 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-53d5a82a-fa86-4937-b4a0-9548891acf43 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-8954ed61-d554-45c5-8f45-a7e3037a8c25-delete_snapshot" released by "delete_snapshot" :: held 2.772s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:09 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Creating offline snapshot 5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a of volume 4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:28:09 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Flow 'volume_create_manager' (b3428786-01ce-4623-a2bf-116dfeb15bd6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933899b9-a065-496a-8225-2d700f5ec66a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f2171d25-0da7-431f-8b84-162b0b230f97]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (933899b9-a065-496a-8225-2d700f5ec66a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-575918616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4d9d84-537e-4b69-a6d3-c96aff4a7783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08994f3b7aa64c6197ddc3c446fee71d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:28:09Z,use_quota=True,user_id='9877ca99454c4f9f9b1cb6296b5ffb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db71f8db-6348-4066-b07d-7146c68dbfea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (db71f8db-6348-4066-b07d-7146c68dbfea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb6a376c-0bab-424d-a64d-ad14f89f244b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fb6a376c-0bab-424d-a64d-ad14f89f244b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'fc4d9d84-537e-4b69-a6d3-c96aff4a7783', 'volume_name': 'volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d391f67d-dbcd-42df-b980-5cea702eee05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d391f67d-dbcd-42df-b980-5cea702eee05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae37420c-933b-48a2-b42e-dbb2639fa86e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:09 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Volume fc4d9d84-537e-4b69-a6d3-c96aff4a7783: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783', 'volume_size': 1}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.552s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:10 devstack quobyte-client[84204]: System call of process 92965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:10 devstack quobyte-client[84204]: System call of process 92965 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:10 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=46, name=volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:28:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a 1G" returned: 0 in 0.350s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] CMD "qemu-img rebase -u -b volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a" returned: 0 in 0.162s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:28:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a" returned: 0 in 0.110s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:28:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a" returned: 0 in 0.110s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.624s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.251s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:28:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesServicesTestJSON-Volume-575918616',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=fc4d9d84-537e-4b69-a6d3-c96aff4a7783,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='08994f3b7aa64c6197ddc3c446fee71d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:28:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:28:09Z,use_quota=True,user_id='9877ca99454c4f9f9b1cb6296b5ffb1c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Creating volume fc4d9d84-537e-4b69-a6d3-c96aff4a7783 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:28:11 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:11 devstack quobyte-client[84204]: System call of process 92973 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:11 devstack quobyte-client[84204]: System call of process 92973 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:11 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=47, name=volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:28:11 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-284356d0-702a-4ddc-b263-d8d9ec850b8d tempest-SnapshotsActionsTest-2129335768 None] Create snapshot completed successfully
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783 1073741824" returned: 0 in 0.527s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783" returned: 0 in 0.096s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] <== create_volume: return (695ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.723s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae37420c-933b-48a2-b42e-dbb2639fa86e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b52d93-ecf5-4c48-9b94-9dc2d8cac75d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:12 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Volume volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783 (fc4d9d84-537e-4b69-a6d3-c96aff4a7783): created successfully
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (39b52d93-ecf5-4c48-9b94-9dc2d8cac75d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Flow 'volume_create_manager' (b3428786-01ce-4623-a2bf-116dfeb15bd6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:28:12 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-19b5fd1d-30a0-4a1d-851a-73894f06b027 tempest-VolumesServicesTestJSON-1917622158 None] Created volume successfully.
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.151s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Acquiring lock "cinder-5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a-delete_snapshot" acquired by "delete_snapshot" :: waited 0.077s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:12 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Acquiring lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" acquired by "delete_snapshot" :: waited 0.016s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Acquiring lock "cinder-quobyte-5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Acquiring lock "cinder-fc4d9d84-537e-4b69-a6d3-c96aff4a7783-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a" acquired by "_delete_snapshot" :: waited 0.039s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Deleting offline snapshot 5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a of volume 4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:28:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] snapshot_file for this snap is: volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:28:13 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[95587027-efe5-411f-9d8e-8bb7d680c396]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Lock "cinder-fc4d9d84-537e-4b69-a6d3-c96aff4a7783-delete_volume" acquired by "delete_volume" :: waited 0.208s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:13 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Acquiring lock "cinder-quobyte-fc4d9d84-537e-4b69-a6d3-c96aff4a7783" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Lock "cinder-quobyte-fc4d9d84-537e-4b69-a6d3-c96aff4a7783" acquired by "delete_volume" :: waited 0.030s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:13 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[48b1d512-0aad-4b8a-b592-4d7526bdf90d]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:13 devstack quobyte-client[84204]: System call of process 92980 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a" returned: 0 in 0.681s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:13 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[efa04221-f76c-45a8-a4bf-606abae676e2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:14 devstack quobyte-client[84204]: System call of process 92981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:14 devstack quobyte-client[84204]: System call of process 92981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:14 devstack quobyte-client[84204]: System call of process 92981 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783" returned: 0 in 0.638s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-fc4d9d84-537e-4b69-a6d3-c96aff4a7783" returned: 0 in 0.118s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Lock "cinder-quobyte-fc4d9d84-537e-4b69-a6d3-c96aff4a7783" released by "delete_volume" :: held 0.952s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:14 devstack quobyte-client[84204]: System call of process 92984 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.817s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:14 devstack quobyte-client[84204]: System call of process 92990 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a" returned: 0 in 0.363s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Created reservations ['d51bfdd7-5601-4ed7-bb94-6aed83554757', '834f9056-618e-4649-8e68-126ff29a07ad', '13490022-8528-422e-a3d9-6b81d184579c', '7e3e30cb-ef9f-4381-ac07-78cf31eaca1c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a" returned: 0 in 0.307s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a" released by "_delete_snapshot" :: held 2.586s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" released by "delete_snapshot" :: held 2.764s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.393s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:15 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:28:16 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Created reservations ['476691cf-0316-428b-91b8-7c318f983f29', '2960b082-d587-42ea-9bb0-f27414b39a63', 'ae59c828-6b55-45ba-a917-2aa73d6787ed', '002d357e-7be1-49f2-b867-7ae17652f589'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:28:16 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Deleted volume successfully.
Sep 24 18:28:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4cf6bbd3-f146-432a-9fdf-2b4513c30e96 tempest-VolumesServicesTestJSON-1917622158 None] Lock "cinder-fc4d9d84-537e-4b69-a6d3-c96aff4a7783-delete_volume" released by "delete_volume" :: held 2.940s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:16 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Delete snapshot completed successfully.
Sep 24 18:28:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a180ed66-f005-4121-9f4b-3219015cffbf tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-5eca1f8f-d4a5-45a6-9eb1-bfcf58485b5a-delete_snapshot" released by "delete_snapshot" :: held 3.249s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:17 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:17 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Creating offline snapshot 9d1e28ad-1104-438f-80c7-01cd9d5e9309 of volume 4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:28:17 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[39358d24-3527-4904-aad0-cae38aa3f3ea]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.567s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:18 devstack quobyte-client[84204]: System call of process 93019 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:18 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=48, name=volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:28:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309 1G" returned: 0 in 0.416s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] CMD "qemu-img rebase -u -b volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309" returned: 0 in 0.204s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:28:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309" returned: 0 in 0.127s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:28:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309" returned: 0 in 0.152s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.844s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:19 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1a758266-a0a8-4dab-bbc7-23b97c6b9703 tempest-SnapshotsActionsTest-2129335768 None] Create snapshot completed successfully
Sep 24 18:28:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Acquiring lock "cinder-9d1e28ad-1104-438f-80c7-01cd9d5e9309-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-9d1e28ad-1104-438f-80c7-01cd9d5e9309-delete_snapshot" acquired by "delete_snapshot" :: waited 0.069s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:21 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Acquiring lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" acquired by "delete_snapshot" :: waited 0.023s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Acquiring lock "cinder-quobyte-9d1e28ad-1104-438f-80c7-01cd9d5e9309" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-9d1e28ad-1104-438f-80c7-01cd9d5e9309" acquired by "_delete_snapshot" :: waited 0.018s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Deleting offline snapshot 9d1e28ad-1104-438f-80c7-01cd9d5e9309 of volume 4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:28:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] snapshot_file for this snap is: volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:28:21 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f6a8b42b-0aef-418a-be9a-5136e5cb448f]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:21 devstack quobyte-client[84204]: System call of process 93028 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309" returned: 0 in 0.612s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:22 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[23cf8921-2776-42f0-a696-50188ae21a18]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.658s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309" returned: 0 in 0.329s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.9d1e28ad-1104-438f-80c7-01cd9d5e9309" returned: 0 in 0.162s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-9d1e28ad-1104-438f-80c7-01cd9d5e9309" released by "_delete_snapshot" :: held 2.162s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" released by "delete_snapshot" :: held 2.194s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:23 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Created reservations ['b05fbc13-e6ec-4b9f-985c-06497c9efa16', '2d48238a-6370-423f-94c2-19c6613783ef', '9dccb478-7356-4d10-b5fe-0044bb38ca67', 'b0addb3a-3799-4749-ab97-e693272006d5'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:28:24 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Delete snapshot completed successfully.
Sep 24 18:28:24 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7fdaff5a-8d02-4b7b-b95c-3974ca022670 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-9d1e28ad-1104-438f-80c7-01cd9d5e9309-delete_snapshot" released by "delete_snapshot" :: held 3.069s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:25 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Creating offline snapshot a27ec568-66bf-4c8e-9dfa-676f6263dc5e of volume 4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:28:25 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[83bafbf0-74e5-442b-8cb1-9f8820e272e7]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:25 devstack quobyte-client[84204]: System call of process 93038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.670s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:26 devstack quobyte-client[84204]: System call of process 93041 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:26 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=49, name=volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:28:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e 1G" returned: 0 in 0.373s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): qemu-img rebase -u -b volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] CMD "qemu-img rebase -u -b volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e" returned: 0 in 0.145s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:26 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:28:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e" returned: 0 in 0.097s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:26 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:28:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e" returned: 0 in 0.102s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.763s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:27 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-62f474e9-f68d-4f28-9fe4-87589ee3db6b tempest-SnapshotsActionsTest-2129335768 None] Create snapshot completed successfully
Sep 24 18:28:28 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Acquiring lock "cinder-a27ec568-66bf-4c8e-9dfa-676f6263dc5e-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:28 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-a27ec568-66bf-4c8e-9dfa-676f6263dc5e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.072s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:28 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:28 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Acquiring lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:28 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" acquired by "delete_snapshot" :: waited 0.015s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:28 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Acquiring lock "cinder-quobyte-a27ec568-66bf-4c8e-9dfa-676f6263dc5e" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:28 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-a27ec568-66bf-4c8e-9dfa-676f6263dc5e" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Deleting offline snapshot a27ec568-66bf-4c8e-9dfa-676f6263dc5e of volume 4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:28:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] snapshot_file for this snap is: volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:28:28 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[89a72a9f-c10b-4283-acbc-a0e0560d53d9]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:29 devstack quobyte-client[84204]: System call of process 93049 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e" returned: 0 in 0.462s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:29 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd3e9e00-9d2e-4b8f-b7cd-dc5a71dfd483]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.444s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e" returned: 0 in 0.284s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.a27ec568-66bf-4c8e-9dfa-676f6263dc5e" returned: 0 in 0.109s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:30 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-a27ec568-66bf-4c8e-9dfa-676f6263dc5e" released by "_delete_snapshot" :: held 1.649s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:30 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" released by "delete_snapshot" :: held 1.674s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:30 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Created reservations ['e39152a7-509a-413c-afe0-09062bb9677b', 'df62bf34-eba2-4ba4-9130-0a1f1436fda5', 'ac14d4f5-4417-403e-b132-0f48046f5741', '2ce24e2e-a7fe-4fac-961d-65f33d4544b0'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:28:30 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Delete snapshot completed successfully.
Sep 24 18:28:30 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdd11747-a14a-435c-b37d-8c0f57479c22 tempest-SnapshotsActionsTest-2046313471 None] Lock "cinder-a27ec568-66bf-4c8e-9dfa-676f6263dc5e-delete_snapshot" released by "delete_snapshot" :: held 2.216s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "cinder-2d6a9890-b902-4a7f-bf5f-ed7b5ab52420-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Lock "cinder-2d6a9890-b902-4a7f-bf5f-ed7b5ab52420-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:32 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "cinder-quobyte-2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Lock "cinder-quobyte-2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Deleting offline snapshot 2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 of volume 4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:28:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] snapshot_file for this snap is: volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:28:32 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbefc423-0203-40f6-b522-ce2c11d086b4]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.586s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:28:33 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[169f075c-4e28-475b-9fec-4ca327f8af05]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a" returned: 0 in 0.591s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:33 devstack quobyte-client[84204]: System call of process 93068 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.257s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a.2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" returned: 0 in 0.129s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Lock "cinder-quobyte-2d6a9890-b902-4a7f-bf5f-ed7b5ab52420" released by "_delete_snapshot" :: held 1.960s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" released by "delete_snapshot" :: held 1.985s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:34 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Created reservations ['7f571dc8-3228-402a-8e3c-5e8a7d8544bd', 'ee54e519-a7eb-406d-9fe9-3d18d9cf759c', '7cbb7dc3-613d-45a1-a7cb-8bd50f15cfdf', 'c507990e-f6b0-4efc-b4b9-b116cec0e483'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:28:34 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Delete snapshot completed successfully.
Sep 24 18:28:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d79d6a-988e-40c6-9338-8c51284d44c1 tempest-SnapshotsActionsTest-2129335768 None] Lock "cinder-2d6a9890-b902-4a7f-bf5f-ed7b5ab52420-delete_snapshot" released by "delete_snapshot" :: held 2.555s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "cinder-4e1fed31-a373-466a-b9b6-ff4c17ae586a-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Lock "cinder-4e1fed31-a373-466a-b9b6-ff4c17ae586a-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:35 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:28:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" acquired by "delete_volume" :: waited 0.025s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:28:35 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[285e91d9-0875-4aa0-854b-24c9810e8893]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:36 devstack quobyte-client[84204]: System call of process 93073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a" returned: 0 in 0.544s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4e1fed31-a373-466a-b9b6-ff4c17ae586a" returned: 0 in 0.134s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:36 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Lock "cinder-quobyte-4e1fed31-a373-466a-b9b6-ff4c17ae586a" released by "delete_volume" :: held 0.934s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:37 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Created reservations ['1047ed22-377d-464e-9eff-c69605abcf39', 'dbb43909-c851-4626-b084-0463aff6eb1c', '4bfbeebb-3c17-46c3-b080-5c46a23cc821', 'c73e1e99-549b-4401-9f61-109a00aaf23e'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:28:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:28:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:28:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.174s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:37 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:28:37 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Deleted volume successfully.
Sep 24 18:28:37 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-67ff6ef3-e3f7-4137-b39c-7c3805745273 tempest-SnapshotsActionsTest-2129335768 None] Lock "cinder-4e1fed31-a373-466a-b9b6-ff4c17ae586a-delete_volume" released by "delete_volume" :: held 2.268s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:28:43 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:43 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:28:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Flow 'volume_create_manager' (5b90d21f-fd40-421e-8f1f-eb7142135651) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:28:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b92144ef-1949-4810-89c9-da19aab2f897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b92144ef-1949-4810-89c9-da19aab2f897) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1743120515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41512a81-4980-48d5-aeb9-11ddfea2df93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8089557873fa4eeba8ad0dfc24e7ed01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:28:43Z,use_quota=True,user_id='f4427c0d82734736b16727c5207cdfc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8096c55f-4998-4c8d-9cd1-9d3f41c726ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8096c55f-4998-4c8d-9cd1-9d3f41c726ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ccff44-dfa9-4082-910f-f441329921e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:43 devstack cinder-volume[84177]: DEBUG cinder.image.glance [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Creating Keystone auth plugin from conf {{(pid=84177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 18:28:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (05ccff44-dfa9-4082-910f-f441329921e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '41512a81-4980-48d5-aeb9-11ddfea2df93', 'volume_name': 'volume-41512a81-4980-48d5-aeb9-11ddfea2df93', 'volume_size': 1, 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31cf1489d51f4b27a6681fc59f94a26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'created_at': datetime.datetime(2025, 9, 24, 16, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 1, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029ff2830>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ebd066-8982-4b7b-a11d-0dba87bde993) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95ebd066-8982-4b7b-a11d-0dba87bde993) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d407ac-65ca-4a1c-a16f-1eef50041bef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:44 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Volume 41512a81-4980-48d5-aeb9-11ddfea2df93: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-41512a81-4980-48d5-aeb9-11ddfea2df93', 'volume_size': 1, 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31cf1489d51f4b27a6681fc59f94a26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'created_at': datetime.datetime(2025, 9, 24, 16, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 1, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029ff2830>}
Sep 24 18:28:44 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Cloning 41512a81-4980-48d5-aeb9-11ddfea2df93 from image f48d314e-3a4b-4449-a990-1eaf5b733ce4  at location (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]). {{(pid=84177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 18:28:45 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_gc2yj5u9devstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 18:28:45 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Image download 20.69 MB at 20.69 MB/s
Sep 24 18:28:45 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f127b6b5-8038-42c7-bc4a-9f70637833d0]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_gc2yj5u9devstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:46 devstack sudo[93132]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_gc2yj5u9devstack@QuobyteHD
Sep 24 18:28:46 devstack sudo[93132]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:28:49 devstack sudo[93132]: pam_unix(sudo:session): session closed for user root
Sep 24 18:28:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_gc2yj5u9devstack@QuobyteHD" returned: 0 in 3.695s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:49 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Temporary image f48d314e-3a4b-4449-a990-1eaf5b733ce4 is fetched for user f4427c0d82734736b16727c5207cdfc9. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 18:28:49 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=59,cinder:UPDATE=73,cinder:DELETE=5,cinder:INSERT=12 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:28:50 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=55,cinder:UPDATE=62,cinder:DELETE=6,cinder:INSERT=20 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:28:50 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[723022d4-91dc-4e70-8455-0b1abebee02c]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_gc2yj5u9devstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:50 devstack sudo[93141]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_gc2yj5u9devstack@QuobyteHD
Sep 24 18:28:50 devstack sudo[93141]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:28:52 devstack sudo[93141]: pam_unix(sudo:session): session closed for user root
Sep 24 18:28:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_gc2yj5u9devstack@QuobyteHD" returned: 0 in 2.655s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:28:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesImageMetadata-Volume-1743120515',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=41512a81-4980-48d5-aeb9-11ddfea2df93,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8089557873fa4eeba8ad0dfc24e7ed01',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:28:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:28:43Z,use_quota=True,user_id='f4427c0d82734736b16727c5207cdfc9',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:28:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Creating volume 41512a81-4980-48d5-aeb9-11ddfea2df93 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:28:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:28:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:28:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:28:52 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:28:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:53 devstack quobyte-client[84204]: System call of process 93146 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:53 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=50, name=volume-41512a81-4980-48d5-aeb9-11ddfea2df93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:28:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93 1073741824" returned: 0 in 0.458s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93" returned: 0 in 0.184s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] <== create_volume: return (777ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:28:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.811s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:53 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Attempting download of f48d314e-3a4b-4449-a990-1eaf5b733ce4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}])) to volume 41512a81-4980-48d5-aeb9-11ddfea2df93. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1184}}
Sep 24 18:28:54 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec74bf1d-f808-442e-9a36-90d9b9b401d7]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_e9awj6fg {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_e9awj6fg" returned: 0 in 0.460s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_e9awj6fg {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_e9awj6fg" returned: 1 in 0.545s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_e9awj6fg' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:28:55 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[667ef5c6-2103-4577-9646-40ada158fea6]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_gc2yj5u9devstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_gc2yj5u9devstack@QuobyteHD" returned: 0 in 0.481s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:55 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] f48d314e-3a4b-4449-a990-1eaf5b733ce4 was qcow2, converting to raw {{(pid=84177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 18:28:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_gc2yj5u9devstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:55 devstack quobyte-client[84204]: System call of process 93157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:55 devstack quobyte-client[84204]: System call of process 93157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:55 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=50, name=volume-41512a81-4980-48d5-aeb9-11ddfea2df93, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_gc2yj5u9devstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93" returned: 0 in 1.305s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_gc2yj5u9devstack@QuobyteHD, size 112.00 MB, duration 1.35 sec, destination /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93 {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:28:57 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Converted 112.00 MB image at 83.00 MB/s
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:57 devstack quobyte-client[84204]: System call of process 93171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:57 devstack quobyte-client[84204]: System call of process 93171 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93 1G" returned: 0 in 0.407s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:57 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Flow 'volume_create_manager' (71f8ecc3-7c12-4e0a-83cd-c381e5c64fae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab50f0ad-2446-4f8e-911b-b31d495ff37a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[056de133-3bad-4df8-8c82-0a937b2aa230]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ab50f0ad-2446-4f8e-911b-b31d495ff37a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1571459949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161018bf-9fba-431a-b1ba-1582a1587df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7faf64add954eae87c54925fe5b8e32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:28:57Z,use_quota=True,user_id='97b7aa2eda1545fbb7409f3e12ea1adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f77f8d-95dd-47a1-a4d5-dfac8f8096a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (02f77f8d-95dd-47a1-a4d5-dfac8f8096a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b33433-5c28-4cd2-9482-087f4be47249) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f2b33433-5c28-4cd2-9482-087f4be47249) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '161018bf-9fba-431a-b1ba-1582a1587df7', 'volume_name': 'volume-161018bf-9fba-431a-b1ba-1582a1587df7', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fd8a65-4b2a-454e-bc6d-b1afca761a0b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (55fd8a65-4b2a-454e-bc6d-b1afca761a0b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed6dd1b-53f5-47a1-873e-3ee3debaed70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:58 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Volume 161018bf-9fba-431a-b1ba-1582a1587df7: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-161018bf-9fba-431a-b1ba-1582a1587df7', 'volume_size': 1}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:28:57Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1571459949',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=161018bf-9fba-431a-b1ba-1582a1587df7,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7faf64add954eae87c54925fe5b8e32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:28:57Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:28:57Z,use_quota=True,user_id='97b7aa2eda1545fbb7409f3e12ea1adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Creating volume 161018bf-9fba-431a-b1ba-1582a1587df7 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:28:58 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-161018bf-9fba-431a-b1ba-1582a1587df7 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:58 devstack quobyte-client[84204]: System call of process 93174 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:58 devstack quobyte-client[84204]: System call of process 93174 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93" returned: 0 in 0.604s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:58 devstack quobyte-client[84204]: System call of process 93175 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:58 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=51, name=volume-161018bf-9fba-431a-b1ba-1582a1587df7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-161018bf-9fba-431a-b1ba-1582a1587df7 1073741824" returned: 0 in 0.574s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-161018bf-9fba-431a-b1ba-1582a1587df7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-161018bf-9fba-431a-b1ba-1582a1587df7" returned: 0 in 0.153s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] <== create_volume: return (850ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:28:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.881s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:28:58 devstack quobyte-client[84204]: System call of process 93178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93" returned: 1 in 0.797s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Downloaded image f48d314e-3a4b-4449-a990-1eaf5b733ce4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}])) to volume 41512a81-4980-48d5-aeb9-11ddfea2df93 successfully. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1229}}
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Temporary image f48d314e-3a4b-4449-a990-1eaf5b733ce4 for user f4427c0d82734736b16727c5207cdfc9 is deleted. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Marking volume 41512a81-4980-48d5-aeb9-11ddfea2df93 as bootable. {{(pid=84177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1133}}
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ed6dd1b-53f5-47a1-873e-3ee3debaed70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-161018bf-9fba-431a-b1ba-1582a1587df7', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d77f9dc-7543-49c1-8fcb-c409820522dc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Copying metadata from image f48d314e-3a4b-4449-a990-1eaf5b733ce4 to 41512a81-4980-48d5-aeb9-11ddfea2df93. {{(pid=84177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Creating volume glance metadata for volume 41512a81-4980-48d5-aeb9-11ddfea2df93 backed by image f48d314e-3a4b-4449-a990-1eaf5b733ce4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 18:28:59 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Volume volume-161018bf-9fba-431a-b1ba-1582a1587df7 (161018bf-9fba-431a-b1ba-1582a1587df7): created successfully
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d77f9dc-7543-49c1-8fcb-c409820522dc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Flow 'volume_create_manager' (71f8ecc3-7c12-4e0a-83cd-c381e5c64fae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:28:59 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-13301887-86ef-47d9-b13f-99fb7e596681 tempest-AttachVolumeNegativeTest-1266788567 None] Created volume successfully.
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (86d407ac-65ca-4a1c-a16f-1eef50041bef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-41512a81-4980-48d5-aeb9-11ddfea2df93', 'volume_size': 1, 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31cf1489d51f4b27a6681fc59f94a26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'created_at': datetime.datetime(2025, 9, 24, 16, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 1, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029ff2830>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00980dd3-a636-41ab-a57a-6a546e44a825) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:28:59 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Volume volume-41512a81-4980-48d5-aeb9-11ddfea2df93 (41512a81-4980-48d5-aeb9-11ddfea2df93): created successfully
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (00980dd3-a636-41ab-a57a-6a546e44a825) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:28:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Flow 'volume_create_manager' (5b90d21f-fd40-421e-8f1f-eb7142135651) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:28:59 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-18c4fb3d-7d73-40eb-bcda-4375e7d3bf0b tempest-VolumesImageMetadata-1895212483 None] Created volume successfully.
Sep 24 18:29:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Acquiring lock "cinder-41512a81-4980-48d5-aeb9-11ddfea2df93-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Lock "cinder-41512a81-4980-48d5-aeb9-11ddfea2df93-delete_volume" acquired by "delete_volume" :: waited 0.081s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:00 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Acquiring lock "cinder-quobyte-41512a81-4980-48d5-aeb9-11ddfea2df93" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Lock "cinder-quobyte-41512a81-4980-48d5-aeb9-11ddfea2df93" acquired by "delete_volume" :: waited 0.013s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:00 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0d0b113-e395-4aad-a32c-225aae6a1cb3]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93" returned: 0 in 0.480s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:01 devstack quobyte-client[84204]: System call of process 93186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:01 devstack quobyte-client[84204]: System call of process 93186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:01 devstack quobyte-client[84204]: System call of process 93186 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93" returned: 1 in 0.484s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:29:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-41512a81-4980-48d5-aeb9-11ddfea2df93" returned: 0 in 0.117s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Lock "cinder-quobyte-41512a81-4980-48d5-aeb9-11ddfea2df93" released by "delete_volume" :: held 1.310s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:02 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Created reservations ['8c087914-cda2-4db0-8e9a-db5a4d3d382a', '8e52faf1-d9ed-4d18-a7d8-0fdfe2e154e5', '40459a2a-39ae-427b-82e4-f795770cf431', '959913e3-bcce-448d-b63a-5e168c661f88'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:29:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:02 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:02 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.084s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:02 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:29:02 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Deleted volume successfully.
Sep 24 18:29:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e0925ac9-0337-473a-bf14-24b4bd8e1dd4 tempest-VolumesImageMetadata-1895212483 None] Lock "cinder-41512a81-4980-48d5-aeb9-11ddfea2df93-delete_volume" released by "delete_volume" :: held 2.468s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:03 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:03 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:29:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Flow 'volume_create_manager' (5bfb6070-02e9-41af-aa65-a6af1173b2ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:29:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e383f652-7f5c-4806-88bc-23c8d1753df3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e383f652-7f5c-4806-88bc-23c8d1753df3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2133925142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc82eb2-cf0c-4666-b310-7d4851e71860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2e86a25af4b9fafad58190ab70c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:29:04Z,use_quota=True,user_id='076d26ce0a4a414383a7bb78d2cfcd37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bad8090-46d0-445d-bfec-10d242abfd4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4bad8090-46d0-445d-bfec-10d242abfd4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e53e3cc-9f65-4605-a462-9733538ed585) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8e53e3cc-9f65-4605-a462-9733538ed585) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'bfc82eb2-cf0c-4666-b310-7d4851e71860', 'volume_name': 'volume-bfc82eb2-cf0c-4666-b310-7d4851e71860', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae3ba92-350c-40f9-9160-ba509e2af3b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5ae3ba92-350c-40f9-9160-ba509e2af3b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa68f505-c234-4ef9-bd66-f4acfc2aed58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:04 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Volume bfc82eb2-cf0c-4666-b310-7d4851e71860: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-bfc82eb2-cf0c-4666-b310-7d4851e71860', 'volume_size': 1}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:29:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeSnapshotQuotasNegativeTestJSON-Volume-2133925142',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bfc82eb2-cf0c-4666-b310-7d4851e71860,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8af2e86a25af4b9fafad58190ab70c7c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:29:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:29:04Z,use_quota=True,user_id='076d26ce0a4a414383a7bb78d2cfcd37',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Creating volume bfc82eb2-cf0c-4666-b310-7d4851e71860 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:29:04 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:04 devstack quobyte-client[84204]: System call of process 93206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:04 devstack quobyte-client[84204]: System call of process 93206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:04 devstack quobyte-client[84204]: System call of process 93206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:04 devstack quobyte-client[84204]: System call of process 93206 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:04 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=52, name=volume-bfc82eb2-cf0c-4666-b310-7d4851e71860, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-66e1cf3f-63db-4538-b18f-ab07f72e8d77 req-ea451ef1-4dbe-4ed4-a413-f0aee93da705 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 1073741824" returned: 0 in 0.461s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860" returned: 0 in 0.192s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] <== create_volume: return (702ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.713s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-66e1cf3f-63db-4538-b18f-ab07f72e8d77 req-ea451ef1-4dbe-4ed4-a413-f0aee93da705 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.521s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1f92e870-d9a5-4516-89ad-e8babb373c6f]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-66e1cf3f-63db-4538-b18f-ab07f72e8d77 req-ea451ef1-4dbe-4ed4-a413-f0aee93da705 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-161018bf-9fba-431a-b1ba-1582a1587df7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (aa68f505-c234-4ef9-bd66-f4acfc2aed58) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bfc82eb2-cf0c-4666-b310-7d4851e71860', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d1e2d0-1720-4386-b2d9-1ade8c82702c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:05 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Volume volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 (bfc82eb2-cf0c-4666-b310-7d4851e71860): created successfully
Sep 24 18:29:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (05d1e2d0-1720-4386-b2d9-1ade8c82702c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Flow 'volume_create_manager' (5bfb6070-02e9-41af-aa65-a6af1173b2ac) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:29:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-5f174ff6-d228-4ed9-8341-36db14d06ddc tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Created volume successfully.
Sep 24 18:29:05 devstack quobyte-client[84204]: System call of process 93210 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:05 devstack quobyte-client[84204]: System call of process 93210 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:05 devstack quobyte-client[84204]: System call of process 93210 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-66e1cf3f-63db-4538-b18f-ab07f72e8d77 req-ea451ef1-4dbe-4ed4-a413-f0aee93da705 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-161018bf-9fba-431a-b1ba-1582a1587df7" returned: 0 in 0.568s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-66e1cf3f-63db-4538-b18f-ab07f72e8d77 req-ea451ef1-4dbe-4ed4-a413-f0aee93da705 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.626s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-66e1cf3f-63db-4538-b18f-ab07f72e8d77 req-ea451ef1-4dbe-4ed4-a413-f0aee93da705 tempest-AttachVolumeNegativeTest-1266788567 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-161018bf-9fba-431a-b1ba-1582a1587df7', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e7fe0155-6f1b-49c0-be27-766ea184c2bf', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:29:05 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-66e1cf3f-63db-4538-b18f-ab07f72e8d77 req-ea451ef1-4dbe-4ed4-a413-f0aee93da705 tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-66e1cf3f-63db-4538-b18f-ab07f72e8d77 req-ea451ef1-4dbe-4ed4-a413-f0aee93da705 tempest-AttachVolumeNegativeTest-1266788567 None] attachment_update completed successfully.
Sep 24 18:29:06 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Creating offline snapshot 6ca91041-ec4a-4723-bde0-b1c1c37a5df1 of volume bfc82eb2-cf0c-4666-b310-7d4851e71860 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:29:06 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[213c3e49-6d53-46b2-98fd-ffbba2bca8b3]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860" returned: 0 in 0.623s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:06 devstack quobyte-client[84204]: System call of process 93218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:06 devstack quobyte-client[84204]: System call of process 93218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:06 devstack quobyte-client[84204]: System call of process 93218 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:07 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=53, name=volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1 1G" returned: 0 in 0.507s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): qemu-img rebase -u -b volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:07 devstack quobyte-client[84204]: System call of process 93286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:07 devstack quobyte-client[84204]: System call of process 93286 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:07 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Flow 'volume_create_manager' (859b07f0-945b-412b-9583-c229b8b66b32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f524f4e8-cb90-4a02-aa45-1b0263090b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "qemu-img rebase -u -b volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1" returned: 0 in 0.501s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f524f4e8-cb90-4a02-aa45-1b0263090b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1725647463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186fcf5a-e2f9-497a-a129-4c7bcfec3df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe56bf5280e44f18b4951eb6b9d5a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:29:07Z,use_quota=True,user_id='975476f3ee96408b99b5767677acf1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b58e202-a3d4-4cf1-abb9-6861233e3c91) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4b58e202-a3d4-4cf1-abb9-6861233e3c91) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757f8fd7-caba-4f74-a558-623963deb753) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (757f8fd7-caba-4f74-a558-623963deb753) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186fcf5a-e2f9-497a-a129-4c7bcfec3df1', 'volume_name': 'volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d9cb2f-3214-49fe-b218-74275c2135cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c2d9cb2f-3214-49fe-b218-74275c2135cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84babe49-e361-445b-8397-877040bd7458) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:07 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Volume 186fcf5a-e2f9-497a-a129-4c7bcfec3df1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1', 'volume_size': 1}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:29:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1" returned: 0 in 0.123s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1" returned: 0 in 0.135s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.info" returned: 0 in 0.113s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.info" returned: 0 in 0.102s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.418s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.872s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:29:06Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotMetadataTestJSON-Volume-1725647463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186fcf5a-e2f9-497a-a129-4c7bcfec3df1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='afe56bf5280e44f18b4951eb6b9d5a8b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:29:07Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:29:07Z,use_quota=True,user_id='975476f3ee96408b99b5767677acf1ff',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Creating volume 186fcf5a-e2f9-497a-a129-4c7bcfec3df1 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:29:08 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:29:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:08 devstack quobyte-client[84204]: System call of process 93612 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:08 devstack quobyte-client[84204]: System call of process 93612 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:09 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=55, name=volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:29:09 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-0c0a6fe3-62bb-4ab4-961f-0b973922d304 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Create snapshot completed successfully
Sep 24 18:29:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 1073741824" returned: 0 in 0.520s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1" returned: 0 in 0.173s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] <== create_volume: return (746ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:29:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.783s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84babe49-e361-445b-8397-877040bd7458) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8928ae-7a4b-4ea6-9639-b884acd051e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:09 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Volume volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 (186fcf5a-e2f9-497a-a129-4c7bcfec3df1): created successfully
Sep 24 18:29:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3e8928ae-7a4b-4ea6-9639-b884acd051e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Flow 'volume_create_manager' (859b07f0-945b-412b-9583-c229b8b66b32) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:29:09 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-5d09267f-5ddb-414c-8ce9-f328b1d4c8be tempest-SnapshotMetadataTestJSON-1369417392 None] Created volume successfully.
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Acquiring lock "cinder-6ca91041-ec4a-4723-bde0-b1c1c37a5df1-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "cinder-6ca91041-ec4a-4723-bde0-b1c1c37a5df1-delete_snapshot" acquired by "delete_snapshot" :: waited 0.030s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:10 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Acquiring lock "cinder-quobyte-bfc82eb2-cf0c-4666-b310-7d4851e71860" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "cinder-quobyte-bfc82eb2-cf0c-4666-b310-7d4851e71860" acquired by "delete_snapshot" :: waited 0.013s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Acquiring lock "cinder-quobyte-6ca91041-ec4a-4723-bde0-b1c1c37a5df1" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "cinder-quobyte-6ca91041-ec4a-4723-bde0-b1c1c37a5df1" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Deleting offline snapshot 6ca91041-ec4a-4723-bde0-b1c1c37a5df1 of volume bfc82eb2-cf0c-4666-b310-7d4851e71860 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] snapshot_file for this snap is: volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0b6bc548-1014-4f08-b1bb-cd71bedf3e07]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:10 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Creating offline snapshot 579796cf-6d7a-4678-b807-1bb1103cbb13 of volume 186fcf5a-e2f9-497a-a129-4c7bcfec3df1 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[19b1bbc1-278f-49b1-9b54-78c31649451f]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:10 devstack quobyte-client[84204]: System call of process 93619 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:10 devstack quobyte-client[84204]: System call of process 93619 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:10 devstack quobyte-client[84204]: System call of process 93619 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:10 devstack quobyte-client[84204]: System call of process 93619 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1" returned: 0 in 0.582s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-bfc82eb2-cf0c-4666-b310-7d4851e71860(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:29:11 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[22b97105-52ac-471d-9cde-4061fd6a3902]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1" returned: 0 in 0.582s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:11 devstack quobyte-client[84204]: System call of process 93623 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:11 devstack quobyte-client[84204]: System call of process 93626 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:11 devstack quobyte-client[84204]: System call of process 93626 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:11 devstack quobyte-client[84204]: System call of process 93626 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:11 devstack quobyte-client[84204]: System call of process 93626 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860" returned: 0 in 0.530s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:11 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=56, name=volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:29:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13 1G" returned: 0 in 0.345s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): qemu-img rebase -u -b volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1" returned: 0 in 0.289s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:12 devstack quobyte-client[84204]: System call of process 93634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "qemu-img rebase -u -b volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13" returned: 0 in 0.223s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860.6ca91041-ec4a-4723-bde0-b1c1c37a5df1" returned: 0 in 0.364s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13" returned: 0 in 0.355s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "cinder-quobyte-6ca91041-ec4a-4723-bde0-b1c1c37a5df1" released by "_delete_snapshot" :: held 2.283s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.388s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "cinder-quobyte-bfc82eb2-cf0c-4666-b310-7d4851e71860" released by "delete_snapshot" :: held 2.355s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13" returned: 0 in 0.358s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.info" returned: 0 in 0.250s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:29:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.info" returned: 0 in 0.269s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.792s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:13 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d81d9684-9d59-4d30-bd23-911fba292934 tempest-SnapshotMetadataTestJSON-1369417392 None] Create snapshot completed successfully
Sep 24 18:29:13 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Created reservations ['c0302acc-96c0-4e31-a0df-2a08ad40da7e', '29071828-a48a-480f-8c0e-2d24a4bd03db', '0ebc93d5-c98b-4a23-af88-db5eca1ac94e', 'e3c4c051-ea65-4d2e-8738-55daf6fb7770'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:29:13 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Delete snapshot completed successfully.
Sep 24 18:29:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b4a2c78-4f98-460f-8f18-1a4f8557ea54 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "cinder-6ca91041-ec4a-4723-bde0-b1c1c37a5df1-delete_snapshot" released by "delete_snapshot" :: held 3.598s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Acquiring lock "cinder-bfc82eb2-cf0c-4666-b310-7d4851e71860-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "cinder-bfc82eb2-cf0c-4666-b310-7d4851e71860-delete_volume" acquired by "delete_volume" :: waited 0.021s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:14 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Acquiring lock "cinder-quobyte-bfc82eb2-cf0c-4666-b310-7d4851e71860" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "cinder-quobyte-bfc82eb2-cf0c-4666-b310-7d4851e71860" acquired by "delete_volume" :: waited 0.017s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:15 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[99c2c206-941e-42d9-936b-612f18b764e1]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:15 devstack quobyte-client[84204]: System call of process 93643 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860" returned: 0 in 0.454s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bfc82eb2-cf0c-4666-b310-7d4851e71860" returned: 0 in 0.120s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "cinder-quobyte-bfc82eb2-cf0c-4666-b310-7d4851e71860" released by "delete_volume" :: held 0.886s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Created reservations ['a218ece0-14cd-4cb4-ba7f-23619899edde', '91c9336f-56d1-4513-8c40-e09fea526032', '6d856a5a-8cbb-44dd-b137-cf7253b82f11', 'c98cfcee-6725-4a95-abaa-dea8b796c8f5'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Acquiring lock "cinder-579796cf-6d7a-4678-b807-1bb1103cbb13-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "cinder-579796cf-6d7a-4678-b807-1bb1103cbb13-delete_snapshot" acquired by "delete_snapshot" :: waited 0.042s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:16 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Acquiring lock "cinder-quobyte-186fcf5a-e2f9-497a-a129-4c7bcfec3df1" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "cinder-quobyte-186fcf5a-e2f9-497a-a129-4c7bcfec3df1" acquired by "delete_snapshot" :: waited 0.052s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Acquiring lock "cinder-quobyte-579796cf-6d7a-4678-b807-1bb1103cbb13" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "cinder-quobyte-579796cf-6d7a-4678-b807-1bb1103cbb13" acquired by "_delete_snapshot" :: waited 0.011s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Deleting offline snapshot 579796cf-6d7a-4678-b807-1bb1103cbb13 of volume 186fcf5a-e2f9-497a-a129-4c7bcfec3df1 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] snapshot_file for this snap is: volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8bbbb260-d7c7-4df2-8a41-2c23fa0b8c7c]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.179s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:16 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:29:16 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Deleted volume successfully.
Sep 24 18:29:17 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-600ecaef-8ba0-4d1d-8169-e0966e0297f2 tempest-VolumeSnapshotQuotasNegativeTestJSON-1392490371 None] Lock "cinder-bfc82eb2-cf0c-4666-b310-7d4851e71860-delete_volume" released by "delete_volume" :: held 2.153s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:17 devstack quobyte-client[84204]: System call of process 93652 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13" returned: 0 in 0.484s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:17 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:29:17 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[35995a0d-3402-4f25-8698-58c28024d601]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:17 devstack quobyte-client[84204]: System call of process 93655 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1" returned: 0 in 0.463s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:17 devstack quobyte-client[84204]: System call of process 93658 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:17 devstack quobyte-client[84204]: System call of process 93658 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13" returned: 0 in 0.261s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1.579796cf-6d7a-4678-b807-1bb1103cbb13" returned: 0 in 0.098s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "cinder-quobyte-579796cf-6d7a-4678-b807-1bb1103cbb13" released by "_delete_snapshot" :: held 1.711s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "cinder-quobyte-186fcf5a-e2f9-497a-a129-4c7bcfec3df1" released by "delete_snapshot" :: held 1.735s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:18 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Created reservations ['ec8f6640-0cc6-474e-87e0-06c57ad262c3', '1f198443-110f-4cac-acce-24f0b95e8b54', 'aefd353a-eb20-407e-92da-aa06c253c69f', '93d7c933-f48e-436a-82d6-3b49a5b635ec'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:29:18 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Delete snapshot completed successfully.
Sep 24 18:29:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8a729616-f46a-42f0-bcc6-7d5a8f4ef15a tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "cinder-579796cf-6d7a-4678-b807-1bb1103cbb13-delete_snapshot" released by "delete_snapshot" :: held 2.314s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Acquiring lock "cinder-186fcf5a-e2f9-497a-a129-4c7bcfec3df1-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "cinder-186fcf5a-e2f9-497a-a129-4c7bcfec3df1-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:19 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Acquiring lock "cinder-quobyte-186fcf5a-e2f9-497a-a129-4c7bcfec3df1" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "cinder-quobyte-186fcf5a-e2f9-497a-a129-4c7bcfec3df1" acquired by "delete_volume" :: waited 0.015s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:19 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2f0070a5-2ed9-4afc-9f90-76ff7fd50af4]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1" returned: 0 in 0.437s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186fcf5a-e2f9-497a-a129-4c7bcfec3df1" returned: 0 in 0.130s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "cinder-quobyte-186fcf5a-e2f9-497a-a129-4c7bcfec3df1" released by "delete_volume" :: held 0.765s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:20 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Created reservations ['9d09440c-7357-4365-9f1b-fc5ccb88db46', 'a0e8e56c-b29f-4b0a-824f-8e3f8f918246', 'b9183001-b42a-4d1a-8d6d-0534cdf01727', 'f5236cbc-f1b2-4344-bdd0-c10a287f5f55'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:29:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.097s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:21 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:29:21 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Deleted volume successfully.
Sep 24 18:29:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-57943797-664b-4bb9-ad1c-35431b9fdaf1 tempest-SnapshotMetadataTestJSON-1369417392 None] Lock "cinder-186fcf5a-e2f9-497a-a129-4c7bcfec3df1-delete_volume" released by "delete_volume" :: held 1.905s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:24 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Flow 'volume_create_manager' (19767487-2f34-4c16-807e-4b25dc60d93d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8ad99f-f7fc-4fbc-b78b-705fb41a6803) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1b8ad99f-f7fc-4fbc-b78b-705fb41a6803) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1534177497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a67337-9ff1-45ee-a4bb-0a75488ea9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67d1ac30fd24bafacb42ec0ed187d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:29:24Z,use_quota=True,user_id='f494b16b0ee2482f8d23521f65967a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5df840d7-bd45-4edd-aaa4-3d9b139e3b21),volume_type_id=5df840d7-bd45-4edd-aaa4-3d9b139e3b21)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d03d30e-649b-4378-9959-76f8491b8e8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6d03d30e-649b-4378-9959-76f8491b8e8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b73202-8575-4f1a-b6ef-01c3927534f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9b73202-8575-4f1a-b6ef-01c3927534f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd5a67337-9ff1-45ee-a4bb-0a75488ea9ea', 'volume_name': 'volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a8cae5-d4b1-44fd-bba9-f192026d4bb9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d0a8cae5-d4b1-44fd-bba9-f192026d4bb9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec9891c-3baf-4b1a-8b29-58c0129e353b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:24 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Volume d5a67337-9ff1-45ee-a4bb-0a75488ea9ea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea', 'volume_size': 1}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:29:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumeTypesAccessTest-Volume-1534177497',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d5a67337-9ff1-45ee-a4bb-0a75488ea9ea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='f67d1ac30fd24bafacb42ec0ed187d9c',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:29:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:29:24Z,use_quota=True,user_id='f494b16b0ee2482f8d23521f65967a85',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(5df840d7-bd45-4edd-aaa4-3d9b139e3b21),volume_type_id=5df840d7-bd45-4edd-aaa4-3d9b139e3b21)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Creating volume d5a67337-9ff1-45ee-a4bb-0a75488ea9ea {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:29:24 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:24 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=58, name=volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea 1073741824" returned: 0 in 0.448s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea" returned: 0 in 0.097s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] <== create_volume: return (650ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:29:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.666s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dec9891c-3baf-4b1a-8b29-58c0129e353b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ff6b66-468d-4702-b745-797784150e2b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:25 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Volume volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea (d5a67337-9ff1-45ee-a4bb-0a75488ea9ea): created successfully
Sep 24 18:29:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b2ff6b66-468d-4702-b745-797784150e2b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Flow 'volume_create_manager' (19767487-2f34-4c16-807e-4b25dc60d93d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:29:25 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-12ae8e34-3d18-4cbf-b558-8999641da301 tempest-VolumeTypesAccessTest-383656780 None] Created volume successfully.
Sep 24 18:29:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Acquiring lock "cinder-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Lock "cinder-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:26 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Acquiring lock "cinder-quobyte-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Lock "cinder-quobyte-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea" acquired by "delete_volume" :: waited 0.014s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:26 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7671416d-2629-4de6-998c-687ef66aa2c5]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:27 devstack quobyte-client[84204]: System call of process 93676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:27 devstack quobyte-client[84204]: System call of process 93676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea" returned: 0 in 0.525s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea" returned: 0 in 0.133s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Lock "cinder-quobyte-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea" released by "delete_volume" :: held 0.860s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:27 devstack cinder-volume[84177]: WARNING cinder.quota [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Deprecated: Default quota for resource: volumes_tempest-VolumeTypesAccessTest-volume-type-591512648 is set by the default quota flag: quota_volumes_tempest-VolumeTypesAccessTest-volume-type-591512648, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:29:27 devstack cinder-volume[84177]: WARNING cinder.quota [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Deprecated: Default quota for resource: gigabytes_tempest-VolumeTypesAccessTest-volume-type-591512648 is set by the default quota flag: quota_gigabytes_tempest-VolumeTypesAccessTest-volume-type-591512648, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:29:27 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Created reservations ['ec731f61-98b3-48d2-8e02-007cd80c3169', 'e0f41a96-7148-4c33-b476-87a4098dc076', '8ccafba6-5d46-420f-ac57-03169327cefb', 'd41f9380-cf75-41ac-876d-f640d645845e'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:29:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.111s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:28 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:29:28 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Deleted volume successfully.
Sep 24 18:29:28 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-42d096dd-e797-42fe-8e4a-323d854a6f7a tempest-VolumeTypesAccessTest-383656780 None] Lock "cinder-d5a67337-9ff1-45ee-a4bb-0a75488ea9ea-delete_volume" released by "delete_volume" :: held 1.937s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:30 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Flow 'volume_create_manager' (06bc675f-44ce-4456-ad2a-f37bec7ea09b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c68fa73-9abb-49d4-9af6-3dca0e2c840b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0c68fa73-9abb-49d4-9af6-3dca0e2c840b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1319021463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96895f2f-31c4-4cbf-80d3-9ba94c0a9acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07e618f2ab446d4b4c8b6d7afae2d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:29:30Z,use_quota=True,user_id='2044861f0c634c50b48272e60bb0c0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d78ea8-ed2c-4474-a15d-751ff48bf639) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72d78ea8-ed2c-4474-a15d-751ff48bf639) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51201cfa-bb13-4b57-bdbe-366a33c17df9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (51201cfa-bb13-4b57-bdbe-366a33c17df9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '96895f2f-31c4-4cbf-80d3-9ba94c0a9acf', 'volume_name': 'volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe1db16-3414-4d34-839b-3c331539ea4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2fe1db16-3414-4d34-839b-3c331539ea4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28c8363-d217-4596-bb5e-80fe70b66d89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:30 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Volume 96895f2f-31c4-4cbf-80d3-9ba94c0a9acf: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf', 'volume_size': 1}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:29:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1319021463',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=96895f2f-31c4-4cbf-80d3-9ba94c0a9acf,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07e618f2ab446d4b4c8b6d7afae2d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:29:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:29:30Z,use_quota=True,user_id='2044861f0c634c50b48272e60bb0c0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Creating volume 96895f2f-31c4-4cbf-80d3-9ba94c0a9acf {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:29:30 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:30 devstack quobyte-client[84204]: System call of process 93706 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:30 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=59, name=volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf 1073741824" returned: 0 in 0.421s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf" returned: 0 in 0.140s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] <== create_volume: return (637ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:29:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.650s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e28c8363-d217-4596-bb5e-80fe70b66d89) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d8ee86-82ff-441a-8668-18e1bbfe12eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:31 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Volume volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf (96895f2f-31c4-4cbf-80d3-9ba94c0a9acf): created successfully
Sep 24 18:29:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (35d8ee86-82ff-441a-8668-18e1bbfe12eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Flow 'volume_create_manager' (06bc675f-44ce-4456-ad2a-f37bec7ea09b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:29:31 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-f23c7407-5a06-4546-a972-566b9c3c8f19 tempest-VolumesTransfersTest-1526537331 None] Created volume successfully.
Sep 24 18:29:33 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-092d88d4-334d-41b4-a9e8-d9d7be88e607 tempest-VolumesTransfersTest-115122433 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:33 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-092d88d4-334d-41b4-a9e8-d9d7be88e607 tempest-VolumesTransfersTest-115122433 None] Transfer volume completed successfully.
Sep 24 18:29:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Acquiring lock "cinder-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Lock "cinder-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf-delete_volume" acquired by "delete_volume" :: waited 0.057s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:34 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Acquiring lock "cinder-quobyte-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Lock "cinder-quobyte-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf" acquired by "delete_volume" :: waited 0.014s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:34 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f1e7dd88-a617-4764-96d3-5b6d72935e30]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:35 devstack quobyte-client[84204]: System call of process 93713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf" returned: 0 in 0.518s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf" returned: 0 in 0.108s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Lock "cinder-quobyte-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf" released by "delete_volume" :: held 0.808s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:35 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Created reservations ['c769850f-525a-406c-b139-8c50a5792b87', '6ef468fc-8d1a-4287-8db6-271c006154d9', '877141e1-0f36-446f-8fef-4d71375f2df8', '015c565e-497e-425f-a86d-d34116292c24'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:29:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.089s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:36 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:29:36 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Deleted volume successfully.
Sep 24 18:29:36 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0dd30554-cbd2-4a6c-920b-891f1390b95a tempest-VolumesTransfersTest-242073974 None] Lock "cinder-96895f2f-31c4-4cbf-80d3-9ba94c0a9acf-delete_volume" released by "delete_volume" :: held 1.837s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:37 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-f2cccad7-bd87-411d-af57-603d3f9c09a4 req-dccf97f5-4057-4284-b318-0d3445fed0a0 tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:37 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-f2cccad7-bd87-411d-af57-603d3f9c09a4 req-dccf97f5-4057-4284-b318-0d3445fed0a0 tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:37 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-f2cccad7-bd87-411d-af57-603d3f9c09a4 req-dccf97f5-4057-4284-b318-0d3445fed0a0 tempest-AttachVolumeNegativeTest-1266788567 None] Terminate volume connection completed successfully.
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-f2cccad7-bd87-411d-af57-603d3f9c09a4 req-dccf97f5-4057-4284-b318-0d3445fed0a0 tempest-AttachVolumeNegativeTest-1266788567 None] Deleting attachment e7fe0155-6f1b-49c0-be27-766ea184c2bf. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:29:37 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Flow 'volume_create_manager' (7eda6494-97f1-4f4c-a5b0-0f00d1e7511a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc5432f-5aaf-44b5-ba3a-db7cec4b8069) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (dcc5432f-5aaf-44b5-ba3a-db7cec4b8069) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1530090680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3ac227-57d7-4add-b7cb-ac96eeb279e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07e618f2ab446d4b4c8b6d7afae2d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:29:38Z,use_quota=True,user_id='2044861f0c634c50b48272e60bb0c0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c77a39-93e2-4efd-b182-c7fc7713eca9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b2c77a39-93e2-4efd-b182-c7fc7713eca9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ff0fc1-0081-4f11-b16f-a7c02e488771) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (43ff0fc1-0081-4f11-b16f-a7c02e488771) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f3ac227-57d7-4add-b7cb-ac96eeb279e9', 'volume_name': 'volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398b3693-f012-402d-8913-1a53ab1027ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (398b3693-f012-402d-8913-1a53ab1027ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85808bcd-9d66-4944-bab9-843bec79d187) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:37 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Volume 6f3ac227-57d7-4add-b7cb-ac96eeb279e9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9', 'volume_size': 1}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:29:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersTest-Volume-1530090680',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f3ac227-57d7-4add-b7cb-ac96eeb279e9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='a07e618f2ab446d4b4c8b6d7afae2d4e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:29:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:29:38Z,use_quota=True,user_id='2044861f0c634c50b48272e60bb0c0b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Creating volume 6f3ac227-57d7-4add-b7cb-ac96eeb279e9 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:29:37 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:29:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:38 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=60, name=volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:29:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9 1073741824" returned: 0 in 0.458s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9" returned: 0 in 0.113s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] <== create_volume: return (642ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:29:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.655s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (85808bcd-9d66-4944-bab9-843bec79d187) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3219f057-01a1-4b02-a5b9-2af985273e78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:38 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Volume volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9 (6f3ac227-57d7-4add-b7cb-ac96eeb279e9): created successfully
Sep 24 18:29:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3219f057-01a1-4b02-a5b9-2af985273e78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Flow 'volume_create_manager' (7eda6494-97f1-4f4c-a5b0-0f00d1e7511a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:29:38 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-8be2688c-29e1-44fe-b2c5-0ff53740102b tempest-VolumesTransfersTest-1526537331 None] Created volume successfully.
Sep 24 18:29:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Acquiring lock "cinder-6f3ac227-57d7-4add-b7cb-ac96eeb279e9-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Lock "cinder-6f3ac227-57d7-4add-b7cb-ac96eeb279e9-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:39 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Acquiring lock "cinder-quobyte-6f3ac227-57d7-4add-b7cb-ac96eeb279e9" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:29:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Lock "cinder-quobyte-6f3ac227-57d7-4add-b7cb-ac96eeb279e9" acquired by "delete_volume" :: waited 0.015s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:29:39 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d13617bc-23d0-43f6-a5aa-2a033ac5bf66]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:29:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9" returned: 0 in 0.524s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f3ac227-57d7-4add-b7cb-ac96eeb279e9" returned: 0 in 0.148s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:40 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Lock "cinder-quobyte-6f3ac227-57d7-4add-b7cb-ac96eeb279e9" released by "delete_volume" :: held 0.930s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:41 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Created reservations ['2e219b74-9fa0-4ceb-aa36-eecf19a98ef4', 'babf4a2c-dd84-4990-987d-e989ad4e3565', 'c41d0efc-208d-48f9-8592-fff90c0c4da2', '1b1384b2-30a5-42a3-8d7a-ae5a594fce8c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:29:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:41 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:41 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.402s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:42 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:29:42 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Deleted volume successfully.
Sep 24 18:29:43 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-957422eb-2100-4af3-83a9-07b0c689f017 tempest-VolumesTransfersTest-242073974 None] Lock "cinder-6f3ac227-57d7-4add-b7cb-ac96eeb279e9-delete_volume" released by "delete_volume" :: held 4.147s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:29:51 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=87,cinder:SELECT=59,cinder:INSERT=17,cinder:DELETE=7 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:29:53 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:INSERT=28,cinder:UPDATE=69,cinder:SELECT=65,cinder:DELETE=8 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:29:56 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Flow 'volume_create_manager' (56583c57-915e-424e-9b1a-d47a56e2349e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24efb10-d08b-45af-874b-a292164e5ead) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f24efb10-d08b-45af-874b-a292164e5ead) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-640652516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743a05b1-b2af-4602-a214-38abd96bf6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391c8961426f4e71807fcd729d456fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:29:56Z,use_quota=True,user_id='af01c1fd4dc147f9a14ad2650bb272a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e3a242-28a8-4ed5-bf3c-436399deba97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d1e3a242-28a8-4ed5-bf3c-436399deba97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cf1df9-74d0-450d-8c51-8165713b88fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (13cf1df9-74d0-450d-8c51-8165713b88fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '743a05b1-b2af-4602-a214-38abd96bf6a0', 'volume_name': 'volume-743a05b1-b2af-4602-a214-38abd96bf6a0', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca1fed2-6a4c-4270-9ebe-357b0fbd9578) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (eca1fed2-6a4c-4270-9ebe-357b0fbd9578) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da633819-6916-404a-9439-7155a5a60096) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:56 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Volume 743a05b1-b2af-4602-a214-38abd96bf6a0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-743a05b1-b2af-4602-a214-38abd96bf6a0', 'volume_size': 1}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:29:55Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-640652516',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=743a05b1-b2af-4602-a214-38abd96bf6a0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391c8961426f4e71807fcd729d456fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:29:56Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:29:56Z,use_quota=True,user_id='af01c1fd4dc147f9a14ad2650bb272a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Creating volume 743a05b1-b2af-4602-a214-38abd96bf6a0 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:29:56 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-743a05b1-b2af-4602-a214-38abd96bf6a0 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:56 devstack quobyte-client[84204]: System call of process 93811 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:56 devstack quobyte-client[84204]: System call of process 93811 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:29:56 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=61, name=volume-743a05b1-b2af-4602-a214-38abd96bf6a0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-743a05b1-b2af-4602-a214-38abd96bf6a0 1073741824" returned: 0 in 0.527s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-743a05b1-b2af-4602-a214-38abd96bf6a0 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:29:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-743a05b1-b2af-4602-a214-38abd96bf6a0" returned: 0 in 0.141s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:29:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] <== create_volume: return (763ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:29:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:29:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da633819-6916-404a-9439-7155a5a60096) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-743a05b1-b2af-4602-a214-38abd96bf6a0', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac875aa-8894-4f89-a24d-09d514438deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:29:57 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Volume volume-743a05b1-b2af-4602-a214-38abd96bf6a0 (743a05b1-b2af-4602-a214-38abd96bf6a0): created successfully
Sep 24 18:29:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8ac875aa-8894-4f89-a24d-09d514438deb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:29:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Flow 'volume_create_manager' (56583c57-915e-424e-9b1a-d47a56e2349e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:29:57 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-2ae911e3-279a-43f0-baf8-a4b71d5b1d93 tempest-VolumesTransfersV357Test-607429392 None] Created volume successfully.
Sep 24 18:29:59 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-35beb80c-1559-41a2-8101-6a9f9fc1e9d3 tempest-VolumesTransfersV357Test-2104487192 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:29:59 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-35beb80c-1559-41a2-8101-6a9f9fc1e9d3 tempest-VolumesTransfersV357Test-2104487192 None] Transfer volume completed successfully.
Sep 24 18:30:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Acquiring lock "cinder-743a05b1-b2af-4602-a214-38abd96bf6a0-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:30:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Lock "cinder-743a05b1-b2af-4602-a214-38abd96bf6a0-delete_volume" acquired by "delete_volume" :: waited 0.090s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:30:00 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:30:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Acquiring lock "cinder-quobyte-743a05b1-b2af-4602-a214-38abd96bf6a0" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:30:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Lock "cinder-quobyte-743a05b1-b2af-4602-a214-38abd96bf6a0" acquired by "delete_volume" :: waited 0.013s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:30:00 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1c652cc6-9f6e-4e54-8b5e-5950e46990fe]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:30:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-743a05b1-b2af-4602-a214-38abd96bf6a0 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:30:01 devstack quobyte-client[84204]: System call of process 93816 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:30:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-743a05b1-b2af-4602-a214-38abd96bf6a0" returned: 0 in 0.551s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:30:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-743a05b1-b2af-4602-a214-38abd96bf6a0 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:30:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-743a05b1-b2af-4602-a214-38abd96bf6a0" returned: 0 in 0.172s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:30:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Lock "cinder-quobyte-743a05b1-b2af-4602-a214-38abd96bf6a0" released by "delete_volume" :: held 0.944s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:30:01 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Created reservations ['87409d5b-1178-419b-b48e-e3d46a25a2d8', '9d1a0a60-0a1b-44ae-9865-2dbffc4e65b2', '33aad8c0-6ee2-4608-b3e2-5f7fb65b43c5', 'ef40ffc3-0cc1-4307-b077-59a1f624dbc3'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:30:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:30:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:30:02 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:30:02 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:30:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:30:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:30:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.109s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:30:02 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:30:02 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Deleted volume successfully.
Sep 24 18:30:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-506fd393-5187-4477-8aa7-4c857f4f333b tempest-VolumesTransfersV357Test-272874710 None] Lock "cinder-743a05b1-b2af-4602-a214-38abd96bf6a0-delete_volume" released by "delete_volume" :: held 1.969s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:30:03 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Flow 'volume_create_manager' (71849b2d-b11a-4b00-9858-4d9470dbf9b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ae8687-0f8b-47b3-a927-278ec73ad024) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11ae8687-0f8b-47b3-a927-278ec73ad024) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1525366994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4506a6e-cd04-41f0-9606-1e67a19b2fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391c8961426f4e71807fcd729d456fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:30:04Z,use_quota=True,user_id='af01c1fd4dc147f9a14ad2650bb272a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51f21c5-f6d3-44b3-ac5a-a46aeac9a5ce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d51f21c5-f6d3-44b3-ac5a-a46aeac9a5ce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0deae4-b35f-48f2-90e4-be710347af81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3d0deae4-b35f-48f2-90e4-be710347af81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'c4506a6e-cd04-41f0-9606-1e67a19b2fac', 'volume_name': 'volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f376c9-2778-43f1-a7b6-b08de67090a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f2f376c9-2778-43f1-a7b6-b08de67090a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a1c6e8-b8e4-4ff5-9d3a-234e2446ab20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:30:03 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Volume c4506a6e-cd04-41f0-9606-1e67a19b2fac: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac', 'volume_size': 1}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:30:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV357Test-Volume-1525366994',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c4506a6e-cd04-41f0-9606-1e67a19b2fac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='391c8961426f4e71807fcd729d456fde',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:30:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:30:04Z,use_quota=True,user_id='af01c1fd4dc147f9a14ad2650bb272a4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Creating volume c4506a6e-cd04-41f0-9606-1e67a19b2fac {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:30:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:30:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:30:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:30:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:30:04 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:30:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:30:04 devstack quobyte-client[84204]: System call of process 93827 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:30:04 devstack quobyte-client[84204]: System call of process 93827 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:30:04 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=62, name=volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:30:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac 1073741824" returned: 0 in 0.681s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:30:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:30:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac" returned: 0 in 0.155s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:30:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] <== create_volume: return (953ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:30:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.983s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:30:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (17a1c6e8-b8e4-4ff5-9d3a-234e2446ab20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:30:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8a298d-1e20-45fc-bbc0-c6356a5b9223) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:30:05 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Volume volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac (c4506a6e-cd04-41f0-9606-1e67a19b2fac): created successfully
Sep 24 18:30:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dd8a298d-1e20-45fc-bbc0-c6356a5b9223) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:30:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Flow 'volume_create_manager' (71849b2d-b11a-4b00-9858-4d9470dbf9b2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:30:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-7f12fbea-1c99-4049-83ed-16764c7882a2 tempest-VolumesTransfersV357Test-607429392 None] Created volume successfully.
Sep 24 18:30:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Acquiring lock "cinder-c4506a6e-cd04-41f0-9606-1e67a19b2fac-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:30:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Lock "cinder-c4506a6e-cd04-41f0-9606-1e67a19b2fac-delete_volume" acquired by "delete_volume" :: waited 0.137s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:30:06 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:30:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Acquiring lock "cinder-quobyte-c4506a6e-cd04-41f0-9606-1e67a19b2fac" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:30:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Lock "cinder-quobyte-c4506a6e-cd04-41f0-9606-1e67a19b2fac" acquired by "delete_volume" :: waited 0.031s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:30:07 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[640c6bed-c4a6-45a9-bbcd-1f93e64d1aa6]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:30:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:30:07 devstack quobyte-client[84204]: System call of process 93836 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:30:07 devstack quobyte-client[84204]: System call of process 93836 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:30:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac" returned: 0 in 0.734s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:30:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:30:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c4506a6e-cd04-41f0-9606-1e67a19b2fac" returned: 0 in 0.128s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:30:08 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Lock "cinder-quobyte-c4506a6e-cd04-41f0-9606-1e67a19b2fac" released by "delete_volume" :: held 1.156s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:30:08 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Created reservations ['28d72179-1737-467e-9874-64c5d91f323f', '6cf04c4c-b626-41a9-9c81-48c46ed7c253', 'eea48e7d-cbde-4cb3-9126-9f34d87a0a17', 'c152a098-1dd5-4b51-9164-bd5ab154b80f'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:30:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:30:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:30:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:30:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:30:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.157s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:30:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:30:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.409s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:30:09 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:30:09 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Deleted volume successfully.
Sep 24 18:30:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-03cec451-2832-4535-be8d-4a052b456d03 tempest-VolumesTransfersV357Test-272874710 None] Lock "cinder-c4506a6e-cd04-41f0-9606-1e67a19b2fac-delete_volume" released by "delete_volume" :: held 3.346s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:30:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:30:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:30:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:30:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:30:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:30:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:30:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:30:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.105s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:30:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:30:18 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=16,cinder:SELECT=9,cinder:INSERT=5,cinder:DELETE=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:30:20 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=16,cinder:DELETE=2,cinder:UPDATE=24,cinder:INSERT=3 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:30:38 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:30:38 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:30:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Flow 'volume_create_manager' (8c7671e7-17dc-43a6-8004-589fb34e46e0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:30:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47acc45a-10e1-465e-b21e-bdf2f3224cba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (47acc45a-10e1-465e-b21e-bdf2f3224cba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1904743757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4094971-2a69-49d5-a618-38fdc031274d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b6b228dde14b71b25cd79288e8818a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:30:38Z,use_quota=True,user_id='3273e192097f419b81221de9887125b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6003b4f-c218-4b43-abc0-cd41b882daec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a6003b4f-c218-4b43-abc0-cd41b882daec) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998d2006-7838-4b8d-8167-5bee6c7eeca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (998d2006-7838-4b8d-8167-5bee6c7eeca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a4094971-2a69-49d5-a618-38fdc031274d', 'volume_name': 'volume-a4094971-2a69-49d5-a618-38fdc031274d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf073fe4-5156-4cc0-8afd-42efee3f47a1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bf073fe4-5156-4cc0-8afd-42efee3f47a1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72620f8d-fc93-407a-ac31-0053bfe8af21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:30:39 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Volume a4094971-2a69-49d5-a618-38fdc031274d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a4094971-2a69-49d5-a618-38fdc031274d', 'volume_size': 1}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:30:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1904743757',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a4094971-2a69-49d5-a618-38fdc031274d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b5b6b228dde14b71b25cd79288e8818a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:30:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:30:38Z,use_quota=True,user_id='3273e192097f419b81221de9887125b7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Creating volume a4094971-2a69-49d5-a618-38fdc031274d {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.072s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:30:39 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:30:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:30:40 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=63, name=volume-a4094971-2a69-49d5-a618-38fdc031274d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:30:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d 1073741824" returned: 0 in 1.254s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:30:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:30:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d" returned: 0 in 0.330s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:30:41 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] <== create_volume: return (2075ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:30:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 2.141s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:30:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (72620f8d-fc93-407a-ac31-0053bfe8af21) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a4094971-2a69-49d5-a618-38fdc031274d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:30:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d75a8d5-40f0-4cba-bbe0-233de352192c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:30:42 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Volume volume-a4094971-2a69-49d5-a618-38fdc031274d (a4094971-2a69-49d5-a618-38fdc031274d): created successfully
Sep 24 18:30:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2d75a8d5-40f0-4cba-bbe0-233de352192c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:30:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Flow 'volume_create_manager' (8c7671e7-17dc-43a6-8004-589fb34e46e0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:30:42 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-52d1e815-bbd8-485b-83e3-a99ec3b160c9 tempest-VolumesActionsTest-722078092 None] Created volume successfully.
Sep 24 18:30:52 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=2,cinder:UPDATE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:30:52 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=3,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:31:08 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Flow 'volume_create_manager' (c136ad18-5ac7-46de-be17-faba876e7c84) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adcf6e86-5127-405a-8213-69127c149a69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adcf6e86-5127-405a-8213-69127c149a69) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-749088380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d857b050-ef21-4c09-8e54-6444a078a8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8c9c3d5aa24fe2a68ee90cd48c11ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:09Z,use_quota=True,user_id='f90324873eb5443a892fa175e2210f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1431f2-b2e6-4453-9a85-47e0cf599a58) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1d1431f2-b2e6-4453-9a85-47e0cf599a58) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc4d97c-271d-4c1d-8af6-cf4a2527e49b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (6dc4d97c-271d-4c1d-8af6-cf4a2527e49b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd857b050-ef21-4c09-8e54-6444a078a8e0', 'volume_name': 'volume-d857b050-ef21-4c09-8e54-6444a078a8e0', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00649d54-3a36-46e9-96d2-95908154b8d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (00649d54-3a36-46e9-96d2-95908154b8d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d451498-b9c4-4e88-92c1-a8c3054eb699) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:08 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Volume d857b050-ef21-4c09-8e54-6444a078a8e0: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d857b050-ef21-4c09-8e54-6444a078a8e0', 'volume_size': 1}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-749088380',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d857b050-ef21-4c09-8e54-6444a078a8e0,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8c9c3d5aa24fe2a68ee90cd48c11ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:09Z,use_quota=True,user_id='f90324873eb5443a892fa175e2210f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Creating volume d857b050-ef21-4c09-8e54-6444a078a8e0 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:31:08 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:31:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d857b050-ef21-4c09-8e54-6444a078a8e0 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:09 devstack quobyte-client[84204]: System call of process 94141 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:09 devstack quobyte-client[84204]: System call of process 94141 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:09 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=64, name=volume-d857b050-ef21-4c09-8e54-6444a078a8e0, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:31:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d857b050-ef21-4c09-8e54-6444a078a8e0 1073741824" returned: 0 in 0.705s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d857b050-ef21-4c09-8e54-6444a078a8e0 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d857b050-ef21-4c09-8e54-6444a078a8e0" returned: 0 in 0.132s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] <== create_volume: return (948ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:31:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.962s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d451498-b9c4-4e88-92c1-a8c3054eb699) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d857b050-ef21-4c09-8e54-6444a078a8e0', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1317cf0e-d865-4098-80c2-b63663c4ebc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:10 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Volume volume-d857b050-ef21-4c09-8e54-6444a078a8e0 (d857b050-ef21-4c09-8e54-6444a078a8e0): created successfully
Sep 24 18:31:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1317cf0e-d865-4098-80c2-b63663c4ebc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Flow 'volume_create_manager' (c136ad18-5ac7-46de-be17-faba876e7c84) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:10 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b61c306f-ef4b-48ba-899f-8740faf7e68c tempest-VolumesActionsTest-1030487700 None] Created volume successfully.
Sep 24 18:31:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-24313b82-6f33-49c5-9f03-268763de6a9e tempest-VolumesActionsTest-1030487700 None] Acquiring lock "cinder-d857b050-ef21-4c09-8e54-6444a078a8e0" by "attach_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-24313b82-6f33-49c5-9f03-268763de6a9e tempest-VolumesActionsTest-1030487700 None] Lock "cinder-d857b050-ef21-4c09-8e54-6444a078a8e0" acquired by "attach_volume" :: waited 0.023s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:11 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-24313b82-6f33-49c5-9f03-268763de6a9e tempest-VolumesActionsTest-1030487700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:11 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-24313b82-6f33-49c5-9f03-268763de6a9e tempest-VolumesActionsTest-1030487700 None] Attaching volume d857b050-ef21-4c09-8e54-6444a078a8e0 to instance a4aeeee2-db5d-42c7-baa5-088aaebf8c88 at mountpoint /dev/vdb on host None.
Sep 24 18:31:11 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-24313b82-6f33-49c5-9f03-268763de6a9e tempest-VolumesActionsTest-1030487700 None] Attach volume completed successfully.
Sep 24 18:31:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-24313b82-6f33-49c5-9f03-268763de6a9e tempest-VolumesActionsTest-1030487700 None] Lock "cinder-d857b050-ef21-4c09-8e54-6444a078a8e0" released by "attach_volume" :: held 0.364s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:12 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-45c8ee36-a6ca-410c-8661-eeca8bd8c901 tempest-VolumesActionsTest-871814377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:12 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-45c8ee36-a6ca-410c-8661-eeca8bd8c901 tempest-VolumesActionsTest-871814377 None] Terminate volume connection completed successfully.
Sep 24 18:31:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:31:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.108s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:31:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-45c8ee36-a6ca-410c-8661-eeca8bd8c901 tempest-VolumesActionsTest-871814377 None] Acquiring lock "cinder-d857b050-ef21-4c09-8e54-6444a078a8e0-detach_volume" by "detach_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-45c8ee36-a6ca-410c-8661-eeca8bd8c901 tempest-VolumesActionsTest-871814377 None] Lock "cinder-d857b050-ef21-4c09-8e54-6444a078a8e0-detach_volume" acquired by "detach_volume" :: waited 0.109s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:13 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-45c8ee36-a6ca-410c-8661-eeca8bd8c901 tempest-VolumesActionsTest-871814377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:13 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-45c8ee36-a6ca-410c-8661-eeca8bd8c901 tempest-VolumesActionsTest-871814377 None] Detaching volume d857b050-ef21-4c09-8e54-6444a078a8e0 from instance a4aeeee2-db5d-42c7-baa5-088aaebf8c88.
Sep 24 18:31:13 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-45c8ee36-a6ca-410c-8661-eeca8bd8c901 tempest-VolumesActionsTest-871814377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:13 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-45c8ee36-a6ca-410c-8661-eeca8bd8c901 tempest-VolumesActionsTest-871814377 None] Detach volume completed successfully.
Sep 24 18:31:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-45c8ee36-a6ca-410c-8661-eeca8bd8c901 tempest-VolumesActionsTest-871814377 None] Lock "cinder-d857b050-ef21-4c09-8e54-6444a078a8e0-detach_volume" released by "detach_volume" :: held 0.387s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6e5e6b5e-2859-44bf-8e7f-7ff461c2b84c tempest-VolumesActionsTest-1030487700 None] Acquiring lock "cinder-d857b050-ef21-4c09-8e54-6444a078a8e0-detach_volume" by "detach_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6e5e6b5e-2859-44bf-8e7f-7ff461c2b84c tempest-VolumesActionsTest-1030487700 None] Lock "cinder-d857b050-ef21-4c09-8e54-6444a078a8e0-detach_volume" acquired by "detach_volume" :: waited 0.022s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:13 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-6e5e6b5e-2859-44bf-8e7f-7ff461c2b84c tempest-VolumesActionsTest-1030487700 None] Volume detach called, but volume not attached.
Sep 24 18:31:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6e5e6b5e-2859-44bf-8e7f-7ff461c2b84c tempest-VolumesActionsTest-1030487700 None] Lock "cinder-d857b050-ef21-4c09-8e54-6444a078a8e0-detach_volume" released by "detach_volume" :: held 0.095s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "cinder-d857b050-ef21-4c09-8e54-6444a078a8e0-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Lock "cinder-d857b050-ef21-4c09-8e54-6444a078a8e0-delete_volume" acquired by "delete_volume" :: waited 0.093s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:15 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "cinder-quobyte-d857b050-ef21-4c09-8e54-6444a078a8e0" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Lock "cinder-quobyte-d857b050-ef21-4c09-8e54-6444a078a8e0" acquired by "delete_volume" :: waited 0.023s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:15 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ebe109d-5d4a-4444-aeb6-c34dcc454c02]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:31:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d857b050-ef21-4c09-8e54-6444a078a8e0 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:16 devstack quobyte-client[84204]: System call of process 94157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:16 devstack quobyte-client[84204]: System call of process 94157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:16 devstack quobyte-client[84204]: System call of process 94157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:16 devstack quobyte-client[84204]: System call of process 94157 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d857b050-ef21-4c09-8e54-6444a078a8e0" returned: 0 in 1.345s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d857b050-ef21-4c09-8e54-6444a078a8e0 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d857b050-ef21-4c09-8e54-6444a078a8e0" returned: 0 in 0.438s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Lock "cinder-quobyte-d857b050-ef21-4c09-8e54-6444a078a8e0" released by "delete_volume" :: held 2.504s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:20 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Created reservations ['3886187a-c585-4dd4-b658-36e1303c4e23', 'a680c7f4-25a0-4c86-9cf4-ca01fa8c4758', '7b213805-ef25-40bd-af2b-1f37da88f44c', 'fd9fe0e7-3309-43fa-b7ff-519ebed504eb'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:31:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.076s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.078s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.412s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:22 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:31:22 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Deleted volume successfully.
Sep 24 18:31:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d4836870-df74-40c8-b5c7-6c4391fe7545 tempest-VolumesActionsTest-1030487700 None] Lock "cinder-d857b050-ef21-4c09-8e54-6444a078a8e0-delete_volume" released by "delete_volume" :: held 8.701s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:31 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=15,cinder:UPDATE=18,cinder:INSERT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:31:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7456ab56-8826-4ab7-b765-57ad34cf29a5 tempest-VolumesActionsTest-722078092 None] Acquiring lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d" by "attach_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7456ab56-8826-4ab7-b765-57ad34cf29a5 tempest-VolumesActionsTest-722078092 None] Lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d" acquired by "attach_volume" :: waited 0.050s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:32 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-7456ab56-8826-4ab7-b765-57ad34cf29a5 tempest-VolumesActionsTest-722078092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:32 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-7456ab56-8826-4ab7-b765-57ad34cf29a5 tempest-VolumesActionsTest-722078092 None] Attaching volume a4094971-2a69-49d5-a618-38fdc031274d to instance 26e7d1fc-39b7-4548-8027-a6dfdf7f15d3 at mountpoint /dev/vdb on host None.
Sep 24 18:31:32 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-7456ab56-8826-4ab7-b765-57ad34cf29a5 tempest-VolumesActionsTest-722078092 None] Attach volume completed successfully.
Sep 24 18:31:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7456ab56-8826-4ab7-b765-57ad34cf29a5 tempest-VolumesActionsTest-722078092 None] Lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d" released by "attach_volume" :: held 0.300s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3fde12c0-f323-4b6a-9bc5-11a1d16368d5 tempest-VolumesActionsTest-722078092 None] Acquiring lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d-detach_volume" by "detach_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3fde12c0-f323-4b6a-9bc5-11a1d16368d5 tempest-VolumesActionsTest-722078092 None] Lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d-detach_volume" acquired by "detach_volume" :: waited 0.051s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:32 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-3fde12c0-f323-4b6a-9bc5-11a1d16368d5 tempest-VolumesActionsTest-722078092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:32 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-3fde12c0-f323-4b6a-9bc5-11a1d16368d5 tempest-VolumesActionsTest-722078092 None] Detaching volume a4094971-2a69-49d5-a618-38fdc031274d from instance 26e7d1fc-39b7-4548-8027-a6dfdf7f15d3.
Sep 24 18:31:32 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-3fde12c0-f323-4b6a-9bc5-11a1d16368d5 tempest-VolumesActionsTest-722078092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:32 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-3fde12c0-f323-4b6a-9bc5-11a1d16368d5 tempest-VolumesActionsTest-722078092 None] Detach volume completed successfully.
Sep 24 18:31:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3fde12c0-f323-4b6a-9bc5-11a1d16368d5 tempest-VolumesActionsTest-722078092 None] Lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d-detach_volume" released by "detach_volume" :: held 0.110s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/collisions: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/collisions: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/multicast: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/multicast: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/rx_bytes: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/rx_bytes: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/rx_compressed: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/rx_compressed: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/rx_crc_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/rx_crc_errors: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/rx_dropped: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/rx_dropped: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/rx_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/rx_errors: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/rx_fifo_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/rx_fifo_errors: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/rx_frame_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/rx_frame_errors: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/rx_length_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/rx_length_errors: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/rx_missed_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/rx_missed_errors: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/rx_nohandler: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/rx_nohandler: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/rx_over_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/rx_over_errors: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/rx_packets: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/rx_packets: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/tx_aborted_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/tx_aborted_errors: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/tx_bytes: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/tx_bytes: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/tx_carrier_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/tx_carrier_errors: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/tx_compressed: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/tx_compressed: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/tx_dropped: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/tx_dropped: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/tx_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/tx_errors: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/tx_fifo_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/tx_fifo_errors: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/tx_heartbeat_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/tx_heartbeat_errors: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/tx_packets: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/tx_packets: stoll
Sep 24 18:31:34 devstack quobyte-client[84204]: Failed to parse file /sys/class/net/tap43bdeb9a-a0/statistics/tx_window_errors: Failed to read/parse sysfs file /sys/class/net/tap43bdeb9a-a0/statistics/tx_window_errors: stoll
Sep 24 18:31:37 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Flow 'volume_create_manager' (64366e08-e9cf-4738-913c-3f30f75ea406) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974e1006-9f30-49f2-8bd1-959423ef40fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (974e1006-9f30-49f2-8bd1-959423ef40fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1993069854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55de95a6-d972-4366-9b90-794e5046b60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8c9c3d5aa24fe2a68ee90cd48c11ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:37Z,use_quota=True,user_id='f90324873eb5443a892fa175e2210f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e649f8cb-26d9-4b3f-b800-9ba75da7a5ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e649f8cb-26d9-4b3f-b800-9ba75da7a5ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819e8b5d-bde7-4d46-b350-4c76ee3ad829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (819e8b5d-bde7-4d46-b350-4c76ee3ad829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '55de95a6-d972-4366-9b90-794e5046b60c', 'volume_name': 'volume-55de95a6-d972-4366-9b90-794e5046b60c', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957b852d-d74c-4d4c-ad17-a029b6542b60) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957b852d-d74c-4d4c-ad17-a029b6542b60) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba79f992-f79f-43c2-89a5-b49bcbe90858) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:37 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Volume 55de95a6-d972-4366-9b90-794e5046b60c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-55de95a6-d972-4366-9b90-794e5046b60c', 'volume_size': 1}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:36Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1993069854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=55de95a6-d972-4366-9b90-794e5046b60c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8c9c3d5aa24fe2a68ee90cd48c11ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:37Z,use_quota=True,user_id='f90324873eb5443a892fa175e2210f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Creating volume 55de95a6-d972-4366-9b90-794e5046b60c {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:31:37 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:31:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-55de95a6-d972-4366-9b90-794e5046b60c 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:37 devstack quobyte-client[84204]: System call of process 94326 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:37 devstack quobyte-client[84204]: System call of process 94326 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:37 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=65, name=volume-55de95a6-d972-4366-9b90-794e5046b60c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:31:38 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Flow 'volume_create_manager' (10b48d9c-5a7b-457c-992f-40552bacfd78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72476736-adea-4860-a212-747a184cd0ad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (72476736-adea-4860-a212-747a184cd0ad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1786397100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2a662b-e7cb-4c65-90e9-b406f2508c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7faf64add954eae87c54925fe5b8e32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:37Z,use_quota=True,user_id='97b7aa2eda1545fbb7409f3e12ea1adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ea2aa-baf2-474c-8b97-a87ad76c9ca8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c64ea2aa-baf2-474c-8b97-a87ad76c9ca8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6422a39-6688-4235-b198-228c50212bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b6422a39-6688-4235-b198-228c50212bb7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9d2a662b-e7cb-4c65-90e9-b406f2508c22', 'volume_name': 'volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac556bb-5a2e-49b7-b65f-7d34851fd40a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6ac556bb-5a2e-49b7-b65f-7d34851fd40a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4847f943-b74e-4b30-a617-a0a88b8f0f48) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:38 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Volume 9d2a662b-e7cb-4c65-90e9-b406f2508c22: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22', 'volume_size': 1}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-55de95a6-d972-4366-9b90-794e5046b60c 1073741824" returned: 0 in 1.168s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-55de95a6-d972-4366-9b90-794e5046b60c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-55de95a6-d972-4366-9b90-794e5046b60c" returned: 0 in 0.118s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] <== create_volume: return (1341ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:31:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.353s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.332s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:37Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AttachVolumeNegativeTest-volume-1786397100',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9d2a662b-e7cb-4c65-90e9-b406f2508c22,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d7faf64add954eae87c54925fe5b8e32',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:37Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:37Z,use_quota=True,user_id='97b7aa2eda1545fbb7409f3e12ea1adb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Creating volume 9d2a662b-e7cb-4c65-90e9-b406f2508c22 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:31:39 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:39 devstack quobyte-client[84204]: System call of process 94332 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:39 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=66, name=volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba79f992-f79f-43c2-89a5-b49bcbe90858) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-55de95a6-d972-4366-9b90-794e5046b60c', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3a666f-b0ca-4455-bfac-c36be99d1a9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22 1073741824" returned: 0 in 0.622s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:39 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Volume volume-55de95a6-d972-4366-9b90-794e5046b60c (55de95a6-d972-4366-9b90-794e5046b60c): created successfully
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e3a666f-b0ca-4455-bfac-c36be99d1a9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Flow 'volume_create_manager' (64366e08-e9cf-4738-913c-3f30f75ea406) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22" returned: 0 in 0.394s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:40 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] <== create_volume: return (1074ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:31:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.092s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:40 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-4e2d90d0-9caa-432f-b3c5-07af635abbf6 tempest-VolumesActionsTest-1030487700 None] Created volume successfully.
Sep 24 18:31:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4847f943-b74e-4b30-a617-a0a88b8f0f48) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5606b8-0dd4-4339-acbf-1ac4be22197f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:40 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Volume volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22 (9d2a662b-e7cb-4c65-90e9-b406f2508c22): created successfully
Sep 24 18:31:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dc5606b8-0dd4-4339-acbf-1ac4be22197f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Flow 'volume_create_manager' (10b48d9c-5a7b-457c-992f-40552bacfd78) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:40 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-43dffb76-94fb-4aa5-b7df-53e1eed7be78 tempest-AttachVolumeNegativeTest-1266788567 None] Created volume successfully.
Sep 24 18:31:40 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Acquiring lock "cinder-55de95a6-d972-4366-9b90-794e5046b60c-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:40 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Lock "cinder-55de95a6-d972-4366-9b90-794e5046b60c-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:41 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:41 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Acquiring lock "cinder-quobyte-55de95a6-d972-4366-9b90-794e5046b60c" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:41 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Lock "cinder-quobyte-55de95a6-d972-4366-9b90-794e5046b60c" acquired by "delete_volume" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:41 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2767f6dd-d16a-401b-a3fc-87b1c81582cc]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:31:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-55de95a6-d972-4366-9b90-794e5046b60c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:41 devstack quobyte-client[84204]: System call of process 94336 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:41 devstack quobyte-client[84204]: System call of process 94336 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-55de95a6-d972-4366-9b90-794e5046b60c" returned: 0 in 0.470s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-55de95a6-d972-4366-9b90-794e5046b60c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-55de95a6-d972-4366-9b90-794e5046b60c" returned: 0 in 0.091s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:41 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Lock "cinder-quobyte-55de95a6-d972-4366-9b90-794e5046b60c" released by "delete_volume" :: held 0.716s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:42 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Created reservations ['f7fd5423-8d36-4428-a64a-9258776cb8b1', '451c3fa2-e79f-4cd2-a97a-1f9efa3f4a6a', '503e37d6-43a3-4441-b9e2-4fb3671c4ffd', '942002d7-1126-4050-9657-1724fb628d92'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:31:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:42 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:42 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.081s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:42 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:31:42 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Deleted volume successfully.
Sep 24 18:31:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8ae72559-58cf-4136-a64c-5d58c718b615 tempest-VolumesActionsTest-871814377 None] Lock "cinder-55de95a6-d972-4366-9b90-794e5046b60c-delete_volume" released by "delete_volume" :: held 1.694s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:43 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:43 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:31:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Flow 'volume_create_manager' (db7259fb-056f-4081-a8ed-9b29856c022e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab87e44-786c-4956-b015-3f95133a2437) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (cab87e44-786c-4956-b015-3f95133a2437) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1715064194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37910bfc-3ae0-4703-adf0-971673f628d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8c9c3d5aa24fe2a68ee90cd48c11ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:44Z,use_quota=True,user_id='f90324873eb5443a892fa175e2210f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c66d853-85ec-42eb-b17c-9cbd917b9d62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (6c66d853-85ec-42eb-b17c-9cbd917b9d62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2dcf259-6123-43da-afe1-136117d3d86d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b2dcf259-6123-43da-afe1-136117d3d86d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '37910bfc-3ae0-4703-adf0-971673f628d9', 'volume_name': 'volume-37910bfc-3ae0-4703-adf0-971673f628d9', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2881e806-def3-4ed1-b475-164176ed5e5e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2881e806-def3-4ed1-b475-164176ed5e5e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173a961b-4324-4feb-960f-f1dcc0923a2f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:44 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Volume 37910bfc-3ae0-4703-adf0-971673f628d9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-37910bfc-3ae0-4703-adf0-971673f628d9', 'volume_size': 1}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1715064194',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=37910bfc-3ae0-4703-adf0-971673f628d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8c9c3d5aa24fe2a68ee90cd48c11ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:44Z,use_quota=True,user_id='f90324873eb5443a892fa175e2210f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Creating volume 37910bfc-3ae0-4703-adf0-971673f628d9 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:31:44 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-37910bfc-3ae0-4703-adf0-971673f628d9 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:44 devstack quobyte-client[84204]: System call of process 94346 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:44 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=67, name=volume-37910bfc-3ae0-4703-adf0-971673f628d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-37910bfc-3ae0-4703-adf0-971673f628d9 1073741824" returned: 0 in 0.499s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-37910bfc-3ae0-4703-adf0-971673f628d9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-37910bfc-3ae0-4703-adf0-971673f628d9" returned: 0 in 0.152s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] <== create_volume: return (759ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:31:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (173a961b-4324-4feb-960f-f1dcc0923a2f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-37910bfc-3ae0-4703-adf0-971673f628d9', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63ed282-df2e-49ff-8106-86b8ed5e8b13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-6f4144ac-487a-4fd3-a9f7-5b2b2c320770 req-04e5d7d7-9c72-4fd6-8818-77f09bdf6823 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-6f4144ac-487a-4fd3-a9f7-5b2b2c320770 req-04e5d7d7-9c72-4fd6-8818-77f09bdf6823 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:45 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Volume volume-37910bfc-3ae0-4703-adf0-971673f628d9 (37910bfc-3ae0-4703-adf0-971673f628d9): created successfully
Sep 24 18:31:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e63ed282-df2e-49ff-8106-86b8ed5e8b13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Flow 'volume_create_manager' (db7259fb-056f-4081-a8ed-9b29856c022e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:45 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[667a1bab-8261-40b1-baa2-07f70505cdc9]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:31:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-6f4144ac-487a-4fd3-a9f7-5b2b2c320770 req-04e5d7d7-9c72-4fd6-8818-77f09bdf6823 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:45 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-02e33131-aeb8-4753-824b-9779ebce69a8 tempest-VolumesActionsTest-1030487700 None] Created volume successfully.
Sep 24 18:31:46 devstack quobyte-client[84204]: System call of process 94353 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Acquiring lock "cinder-37910bfc-3ae0-4703-adf0-971673f628d9-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Lock "cinder-37910bfc-3ae0-4703-adf0-971673f628d9-delete_volume" acquired by "delete_volume" :: waited 0.089s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-6f4144ac-487a-4fd3-a9f7-5b2b2c320770 req-04e5d7d7-9c72-4fd6-8818-77f09bdf6823 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22" returned: 0 in 1.421s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-6f4144ac-487a-4fd3-a9f7-5b2b2c320770 req-04e5d7d7-9c72-4fd6-8818-77f09bdf6823 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.516s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:46 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Acquiring lock "cinder-quobyte-37910bfc-3ae0-4703-adf0-971673f628d9" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Lock "cinder-quobyte-37910bfc-3ae0-4703-adf0-971673f628d9" acquired by "delete_volume" :: waited 0.027s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-6f4144ac-487a-4fd3-a9f7-5b2b2c320770 req-04e5d7d7-9c72-4fd6-8818-77f09bdf6823 tempest-AttachVolumeNegativeTest-1266788567 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '12f077fc-dacc-4de7-b0ca-14649ab55410', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:31:47 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-6f4144ac-487a-4fd3-a9f7-5b2b2c320770 req-04e5d7d7-9c72-4fd6-8818-77f09bdf6823 tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:47 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ed4f8051-0392-481c-ad18-2c571da53aa2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:31:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-37910bfc-3ae0-4703-adf0-971673f628d9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:47 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-6f4144ac-487a-4fd3-a9f7-5b2b2c320770 req-04e5d7d7-9c72-4fd6-8818-77f09bdf6823 tempest-AttachVolumeNegativeTest-1266788567 None] attachment_update completed successfully.
Sep 24 18:31:47 devstack quobyte-client[84204]: System call of process 94389 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:47 devstack quobyte-client[84204]: System call of process 94389 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-37910bfc-3ae0-4703-adf0-971673f628d9" returned: 0 in 0.662s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-37910bfc-3ae0-4703-adf0-971673f628d9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-37910bfc-3ae0-4703-adf0-971673f628d9" returned: 0 in 0.217s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Lock "cinder-quobyte-37910bfc-3ae0-4703-adf0-971673f628d9" released by "delete_volume" :: held 1.172s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:48 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Created reservations ['05f9a79b-5b71-4c46-b847-f5afa7746280', 'b8e6c191-31ab-473c-8872-8ee0209c8ec2', '433b05e1-3021-4631-9c7c-89ec84684e1e', '778c691f-f6d7-4522-a8ab-2b2f1afdb8a7'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:31:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.007s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.164s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:49 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:31:49 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Deleted volume successfully.
Sep 24 18:31:49 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7b773576-d74c-4c3f-8466-34ea4663284f tempest-VolumesActionsTest-871814377 None] Lock "cinder-37910bfc-3ae0-4703-adf0-971673f628d9-delete_volume" released by "delete_volume" :: held 3.125s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:51 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Flow 'volume_create_manager' (5b65a07f-a28d-4681-98ac-08535c2e340c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90250c0a-35b1-4f7f-9c8a-0815675d915a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (90250c0a-35b1-4f7f-9c8a-0815675d915a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1885769774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ea60dc-8f99-4c06-af53-e195cdc6bcc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8c9c3d5aa24fe2a68ee90cd48c11ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:51Z,use_quota=True,user_id='f90324873eb5443a892fa175e2210f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af61471-7e3c-49bc-bfa9-21df24a357c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2af61471-7e3c-49bc-bfa9-21df24a357c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40f1f7d-fc64-4b3b-be6d-a1e9863788b0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f40f1f7d-fc64-4b3b-be6d-a1e9863788b0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '14ea60dc-8f99-4c06-af53-e195cdc6bcc5', 'volume_name': 'volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5666d4-6c00-4528-8718-ec7893f07d3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fa5666d4-6c00-4528-8718-ec7893f07d3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34074275-085e-4bfb-936a-6b8182e370cf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:51 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Volume 14ea60dc-8f99-4c06-af53-e195cdc6bcc5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5', 'volume_size': 1}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-1885769774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=14ea60dc-8f99-4c06-af53-e195cdc6bcc5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8c9c3d5aa24fe2a68ee90cd48c11ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:51Z,use_quota=True,user_id='f90324873eb5443a892fa175e2210f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Creating volume 14ea60dc-8f99-4c06-af53-e195cdc6bcc5 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:31:51 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:31:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:51 devstack quobyte-client[84204]: System call of process 94789 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:51 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=68, name=volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:31:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5 1073741824" returned: 0 in 0.727s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5" returned: 0 in 0.131s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] <== create_volume: return (940ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:31:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.957s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (34074275-085e-4bfb-936a-6b8182e370cf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf83235-ef47-4d40-8741-b3ee812302c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:52 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Volume volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5 (14ea60dc-8f99-4c06-af53-e195cdc6bcc5): created successfully
Sep 24 18:31:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fcf83235-ef47-4d40-8741-b3ee812302c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Flow 'volume_create_manager' (5b65a07f-a28d-4681-98ac-08535c2e340c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:52 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a6d4b6dd-9606-4aea-8885-f08fa48accc3 tempest-VolumesActionsTest-1030487700 None] Created volume successfully.
Sep 24 18:31:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Acquiring lock "cinder-14ea60dc-8f99-4c06-af53-e195cdc6bcc5-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Lock "cinder-14ea60dc-8f99-4c06-af53-e195cdc6bcc5-delete_volume" acquired by "delete_volume" :: waited 0.076s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Acquiring lock "cinder-quobyte-14ea60dc-8f99-4c06-af53-e195cdc6bcc5" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:31:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Lock "cinder-quobyte-14ea60dc-8f99-4c06-af53-e195cdc6bcc5" acquired by "delete_volume" :: waited 0.024s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:31:53 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[17ab4caf-38df-42a2-8c15-bf0f5f3267ad]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:31:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:54 devstack quobyte-client[84204]: System call of process 94796 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:54 devstack quobyte-client[84204]: System call of process 94796 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:54 devstack quobyte-client[84204]: System call of process 94796 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5" returned: 0 in 0.945s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-14ea60dc-8f99-4c06-af53-e195cdc6bcc5" returned: 0 in 0.244s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Lock "cinder-quobyte-14ea60dc-8f99-4c06-af53-e195cdc6bcc5" released by "delete_volume" :: held 1.532s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:56 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Created reservations ['c3065c21-82bc-413f-ac92-465ab69d5cbb', '27557596-2a6f-4bfc-9940-8980db3d6e38', 'b685d165-7198-44ea-a962-4682f53af085', '8828ba9f-ca72-49fd-afa3-9816cebfdb70'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:31:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.036s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.248s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:56 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:31:57 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Deleted volume successfully.
Sep 24 18:31:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1afd08c6-ecf2-4a2f-8c4d-b45ba25cf79d tempest-VolumesActionsTest-871814377 None] Lock "cinder-14ea60dc-8f99-4c06-af53-e195cdc6bcc5-delete_volume" released by "delete_volume" :: held 3.930s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:31:58 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Flow 'volume_create_manager' (179fea77-1557-4652-9b35-a4dace8ba99f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f82aee2-7c5b-4664-b427-6c966b52a884) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6f82aee2-7c5b-4664-b427-6c966b52a884) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2112927577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df05fcb-0f87-4eff-bf98-962183bf9192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8c9c3d5aa24fe2a68ee90cd48c11ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:58Z,use_quota=True,user_id='f90324873eb5443a892fa175e2210f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d228b725-0d8f-4e4d-a04b-2e165a200f0f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d228b725-0d8f-4e4d-a04b-2e165a200f0f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ecb4f37-3610-4a60-9162-6c23f63aff3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3ecb4f37-3610-4a60-9162-6c23f63aff3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0df05fcb-0f87-4eff-bf98-962183bf9192', 'volume_name': 'volume-0df05fcb-0f87-4eff-bf98-962183bf9192', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905b97e7-288b-48b2-bf56-5bb5977a2973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (905b97e7-288b-48b2-bf56-5bb5977a2973) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef1c297-1a1b-4d67-922b-82388650c2a0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:58 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Volume 0df05fcb-0f87-4eff-bf98-962183bf9192: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0df05fcb-0f87-4eff-bf98-962183bf9192', 'volume_size': 1}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:31:58Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-2112927577',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0df05fcb-0f87-4eff-bf98-962183bf9192,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8c9c3d5aa24fe2a68ee90cd48c11ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:31:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:31:58Z,use_quota=True,user_id='f90324873eb5443a892fa175e2210f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Creating volume 0df05fcb-0f87-4eff-bf98-962183bf9192 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:31:58 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0df05fcb-0f87-4eff-bf98-962183bf9192 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:58 devstack quobyte-client[84204]: System call of process 94816 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:31:58 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=69, name=volume-0df05fcb-0f87-4eff-bf98-962183bf9192, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0df05fcb-0f87-4eff-bf98-962183bf9192 1073741824" returned: 0 in 0.370s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0df05fcb-0f87-4eff-bf98-962183bf9192 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0df05fcb-0f87-4eff-bf98-962183bf9192" returned: 0 in 0.150s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] <== create_volume: return (587ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:31:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.599s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:31:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1ef1c297-1a1b-4d67-922b-82388650c2a0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0df05fcb-0f87-4eff-bf98-962183bf9192', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74eb3f0-16e5-4de1-8ac3-f329e8a02f1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:31:59 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Volume volume-0df05fcb-0f87-4eff-bf98-962183bf9192 (0df05fcb-0f87-4eff-bf98-962183bf9192): created successfully
Sep 24 18:31:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b74eb3f0-16e5-4de1-8ac3-f329e8a02f1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:31:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Flow 'volume_create_manager' (179fea77-1557-4652-9b35-a4dace8ba99f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:31:59 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-efa661e8-8baa-4f7a-84b5-a4ff167c9ad7 tempest-VolumesActionsTest-1030487700 None] Created volume successfully.
Sep 24 18:32:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Acquiring lock "cinder-0df05fcb-0f87-4eff-bf98-962183bf9192-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Lock "cinder-0df05fcb-0f87-4eff-bf98-962183bf9192-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:00 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Acquiring lock "cinder-quobyte-0df05fcb-0f87-4eff-bf98-962183bf9192" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Lock "cinder-quobyte-0df05fcb-0f87-4eff-bf98-962183bf9192" acquired by "delete_volume" :: waited 0.015s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:00 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[65a6435f-63b0-4774-8222-7f7e8ef21531]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0df05fcb-0f87-4eff-bf98-962183bf9192 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0df05fcb-0f87-4eff-bf98-962183bf9192" returned: 0 in 0.488s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0df05fcb-0f87-4eff-bf98-962183bf9192 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0df05fcb-0f87-4eff-bf98-962183bf9192" returned: 0 in 0.103s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Lock "cinder-quobyte-0df05fcb-0f87-4eff-bf98-962183bf9192" released by "delete_volume" :: held 0.748s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:01 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Created reservations ['1ce3606a-7564-4d9d-9768-b2dc7b406729', '8e377c91-d1f6-46e2-8098-5f6b2050c603', '6deec7cf-bde2-42cf-85d9-4753c52d4593', 'b1419bf0-f3fc-48f6-ac84-c076bc37285c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:32:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.111s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:02 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:32:02 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Deleted volume successfully.
Sep 24 18:32:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-2c8bd353-d4c9-4240-ad9b-b67f49d69649 tempest-VolumesActionsTest-871814377 None] Lock "cinder-0df05fcb-0f87-4eff-bf98-962183bf9192-delete_volume" released by "delete_volume" :: held 1.745s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=49,cinder:DELETE=6,cinder:INSERT=14,cinder:SELECT=49 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:32:03 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Flow 'volume_create_manager' (86035bc6-fb9a-4946-bc4b-c5d44fa08eb6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b633df-b395-42f0-95da-8eb47a0bc2f2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (77b633df-b395-42f0-95da-8eb47a0bc2f2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-788796059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b1edb5-f4d6-47a8-ba34-a914fad8daf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8c9c3d5aa24fe2a68ee90cd48c11ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:32:03Z,use_quota=True,user_id='f90324873eb5443a892fa175e2210f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7494d061-b0a2-478a-96df-52375e091ff2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7494d061-b0a2-478a-96df-52375e091ff2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bb34c2-a9a0-4166-b88d-70f270274ee8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11bb34c2-a9a0-4166-b88d-70f270274ee8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '75b1edb5-f4d6-47a8-ba34-a914fad8daf3', 'volume_name': 'volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963e87e3-3fe6-4205-9e2c-d8b11d5fdc75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963e87e3-3fe6-4205-9e2c-d8b11d5fdc75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f9e92b-da4a-48a9-abc2-7697ad4268c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:03 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Volume 75b1edb5-f4d6-47a8-ba34-a914fad8daf3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3', 'volume_size': 1}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:32:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesActionsTest-Volume-788796059',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=75b1edb5-f4d6-47a8-ba34-a914fad8daf3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='ee8c9c3d5aa24fe2a68ee90cd48c11ba',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:32:03Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:32:03Z,use_quota=True,user_id='f90324873eb5443a892fa175e2210f3e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Creating volume 75b1edb5-f4d6-47a8-ba34-a914fad8daf3 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:32:03 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:32:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:03 devstack quobyte-client[84204]: System call of process 94840 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:03 devstack quobyte-client[84204]: System call of process 94840 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:04 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=70, name=volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:32:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3 1073741824" returned: 0 in 0.538s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3" returned: 0 in 0.144s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] <== create_volume: return (806ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:32:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.819s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (97f9e92b-da4a-48a9-abc2-7697ad4268c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a515c4d-cf39-4445-a3cc-813f8d1db652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:04 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Volume volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3 (75b1edb5-f4d6-47a8-ba34-a914fad8daf3): created successfully
Sep 24 18:32:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a515c4d-cf39-4445-a3cc-813f8d1db652) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Flow 'volume_create_manager' (86035bc6-fb9a-4946-bc4b-c5d44fa08eb6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:32:04 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-f63ded9e-58a0-4396-9efe-97104dbf10ec tempest-VolumesActionsTest-1030487700 None] Created volume successfully.
Sep 24 18:32:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "cinder-75b1edb5-f4d6-47a8-ba34-a914fad8daf3-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Lock "cinder-75b1edb5-f4d6-47a8-ba34-a914fad8daf3-delete_volume" acquired by "delete_volume" :: waited 0.124s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:08 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:08 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "cinder-quobyte-75b1edb5-f4d6-47a8-ba34-a914fad8daf3" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:08 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Lock "cinder-quobyte-75b1edb5-f4d6-47a8-ba34-a914fad8daf3" acquired by "delete_volume" :: waited 0.014s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:08 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4c2dbc23-40d3-4daa-bc99-95d74069e2af]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:09 devstack quobyte-client[84204]: System call of process 94913 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:09 devstack quobyte-client[84204]: System call of process 94913 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:09 devstack quobyte-client[84204]: System call of process 94913 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3" returned: 0 in 0.979s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-75b1edb5-f4d6-47a8-ba34-a914fad8daf3" returned: 0 in 0.178s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Lock "cinder-quobyte-75b1edb5-f4d6-47a8-ba34-a914fad8daf3" released by "delete_volume" :: held 1.481s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:10 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Created reservations ['c7963874-a201-46e8-b5ee-c805c715375c', '5bf71ef5-abe8-40d2-9858-ea5998a92c88', '7097df8e-2e1e-4bc4-9f3e-0a55c7491292', 'd2a978ca-12c0-4440-9f73-5c1db300d4fd'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:32:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.110s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:10 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:32:10 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Deleted volume successfully.
Sep 24 18:32:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-20f2c4b3-15e8-4315-882f-d0e4871a6548 tempest-VolumesActionsTest-1030487700 None] Lock "cinder-75b1edb5-f4d6-47a8-ba34-a914fad8daf3-delete_volume" released by "delete_volume" :: held 2.930s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:32:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.170s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:32:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4991b09d-e104-42b6-a495-7a826d0831ac tempest-VolumesActionsTest-722078092 None] Acquiring lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d" by "attach_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4991b09d-e104-42b6-a495-7a826d0831ac tempest-VolumesActionsTest-722078092 None] Lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d" acquired by "attach_volume" :: waited 0.160s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:15 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-4991b09d-e104-42b6-a495-7a826d0831ac tempest-VolumesActionsTest-722078092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:15 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-4991b09d-e104-42b6-a495-7a826d0831ac tempest-VolumesActionsTest-722078092 None] Attaching volume a4094971-2a69-49d5-a618-38fdc031274d to instance d4ad282a-de57-4232-9671-8198b005d96f at mountpoint /dev/vdb on host None.
Sep 24 18:32:15 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-4991b09d-e104-42b6-a495-7a826d0831ac tempest-VolumesActionsTest-722078092 None] Attach volume completed successfully.
Sep 24 18:32:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4991b09d-e104-42b6-a495-7a826d0831ac tempest-VolumesActionsTest-722078092 None] Lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d" released by "attach_volume" :: held 0.424s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e4730d63-08a2-4e68-a8ff-7941167f5578 tempest-VolumesActionsTest-722078092 None] Acquiring lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d-detach_volume" by "detach_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e4730d63-08a2-4e68-a8ff-7941167f5578 tempest-VolumesActionsTest-722078092 None] Lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d-detach_volume" acquired by "detach_volume" :: waited 0.021s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:16 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e4730d63-08a2-4e68-a8ff-7941167f5578 tempest-VolumesActionsTest-722078092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:16 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e4730d63-08a2-4e68-a8ff-7941167f5578 tempest-VolumesActionsTest-722078092 None] Detaching volume a4094971-2a69-49d5-a618-38fdc031274d from instance d4ad282a-de57-4232-9671-8198b005d96f.
Sep 24 18:32:16 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e4730d63-08a2-4e68-a8ff-7941167f5578 tempest-VolumesActionsTest-722078092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:16 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e4730d63-08a2-4e68-a8ff-7941167f5578 tempest-VolumesActionsTest-722078092 None] Detach volume completed successfully.
Sep 24 18:32:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e4730d63-08a2-4e68-a8ff-7941167f5578 tempest-VolumesActionsTest-722078092 None] Lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d-detach_volume" released by "detach_volume" :: held 0.193s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:20 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-5bbd8121-c17d-4ca4-9d4f-705a49f653d4 req-6963c9dc-c9a4-4121-a589-1acf39019cce tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:20 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-5bbd8121-c17d-4ca4-9d4f-705a49f653d4 req-6963c9dc-c9a4-4121-a589-1acf39019cce tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:20 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-5bbd8121-c17d-4ca4-9d4f-705a49f653d4 req-6963c9dc-c9a4-4121-a589-1acf39019cce tempest-AttachVolumeNegativeTest-1266788567 None] Terminate volume connection completed successfully.
Sep 24 18:32:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-5bbd8121-c17d-4ca4-9d4f-705a49f653d4 req-6963c9dc-c9a4-4121-a589-1acf39019cce tempest-AttachVolumeNegativeTest-1266788567 None] Deleting attachment 12f077fc-dacc-4de7-b0ca-14649ab55410. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:32:26 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=10,cinder:SELECT=13,cinder:INSERT=5,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:32:30 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=52,cinder:UPDATE=70,cinder:INSERT=9,cinder:DELETE=6 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:32:30 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:31 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c2ffb912-0f73-4334-89c4-d4a6e1ccff46]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:31 devstack quobyte-client[84204]: System call of process 95045 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:31 devstack quobyte-client[84204]: System call of process 95045 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d" returned: 0 in 0.673s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:31 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[cd702566-ad87-4ec5-ad54-d8544683351b]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:32 devstack quobyte-client[84204]: System call of process 95048 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d" returned: 0 in 0.573s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.d8c1ad0b-57ef-433b-b740-4f0614b15790im0ncsc3.img {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.d8c1ad0b-57ef-433b-b740-4f0614b15790im0ncsc3.img" returned: 0 in 6.532s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6001cbda-8f98-4eb5-aef4-14bee3a1f05a]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "cinder-9d2a662b-e7cb-4c65-90e9-b406f2508c22-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "cinder-9d2a662b-e7cb-4c65-90e9-b406f2508c22-delete_volume" acquired by "delete_volume" :: waited 0.187s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:39 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Flow 'volume_create_manager' (93893cdf-9b98-4ccb-89d6-2385fea263e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819b77d0-2312-4612-90af-9b5fab1b1a19) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:39 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "cinder-quobyte-9d2a662b-e7cb-4c65-90e9-b406f2508c22" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d" returned: 0 in 0.783s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (819b77d0-2312-4612-90af-9b5fab1b1a19) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1731617953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cd834f-17c9-4405-abc7-3132436ae5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41092410554844869767a4abe96f3878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:32:40Z,use_quota=True,user_id='22f6f3d1b0474391bc0827e7f17c02e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ce8c94-5828-40f2-830f-523f91c27569) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (84ce8c94-5828-40f2-830f-523f91c27569) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d7e589-e793-444f-b3ed-0d2236193784) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c9d7e589-e793-444f-b3ed-0d2236193784) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '45cd834f-17c9-4405-abc7-3132436ae5b1', 'volume_name': 'volume-45cd834f-17c9-4405-abc7-3132436ae5b1', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dceb1b1-ff4e-410d-a7cd-c52b3b717318) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1dceb1b1-ff4e-410d-a7cd-c52b3b717318) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fcecfe-3951-4d08-a2f9-c24b0d911022) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:32:39 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Volume 45cd834f-17c9-4405-abc7-3132436ae5b1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-45cd834f-17c9-4405-abc7-3132436ae5b1', 'volume_size': 1}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d, size 1024.00 MB, duration 6.60 sec, destination /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.d8c1ad0b-57ef-433b-b740-4f0614b15790im0ncsc3.img {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:32:39 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] Converted 1024.00 MB image at 155.07 MB/s
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "cinder-quobyte-9d2a662b-e7cb-4c65-90e9-b406f2508c22" acquired by "delete_volume" :: waited 0.093s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] d8c1ad0b-57ef-433b-b740-4f0614b15790 was raw, no need to convert to raw {{(pid=84177) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1127}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[816b084c-eb6a-454c-9a5a-5656d263364c]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:40 devstack quobyte-client[84204]: System call of process 95068 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22" returned: 0 in 0.646s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9d2a662b-e7cb-4c65-90e9-b406f2508c22" returned: 0 in 0.313s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:41 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "cinder-quobyte-9d2a662b-e7cb-4c65-90e9-b406f2508c22" released by "delete_volume" :: held 1.146s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:41 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Created reservations ['2ddb0bdf-f554-44dc-9bd0-0068bd13a00a', 'caabc3e6-9493-48d4-bb3b-bbb20052cf24', 'cc136909-fadc-43fe-b248-67e088f57a99', '1327ea1b-1f8f-4156-acb7-352c630a77d8'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:32:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:41 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:41 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.109s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:41 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:32:41 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Deleted volume successfully.
Sep 24 18:32:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ea21a81e-7a55-400e-bee6-fc2becd01cd8 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "cinder-9d2a662b-e7cb-4c65-90e9-b406f2508c22-delete_volume" released by "delete_volume" :: held 2.652s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "cinder-161018bf-9fba-431a-b1ba-1582a1587df7-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:43 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "cinder-161018bf-9fba-431a-b1ba-1582a1587df7-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:43 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:43 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "cinder-quobyte-161018bf-9fba-431a-b1ba-1582a1587df7" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:43 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "cinder-quobyte-161018bf-9fba-431a-b1ba-1582a1587df7" acquired by "delete_volume" :: waited 0.093s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:43 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3268f023-f327-4e30-8251-f0a9057394e0]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-161018bf-9fba-431a-b1ba-1582a1587df7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:44 devstack quobyte-client[84204]: System call of process 95073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:44 devstack quobyte-client[84204]: System call of process 95073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:44 devstack quobyte-client[84204]: System call of process 95073 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-161018bf-9fba-431a-b1ba-1582a1587df7" returned: 0 in 0.697s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-161018bf-9fba-431a-b1ba-1582a1587df7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-161018bf-9fba-431a-b1ba-1582a1587df7" returned: 0 in 0.152s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:44 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "cinder-quobyte-161018bf-9fba-431a-b1ba-1582a1587df7" released by "delete_volume" :: held 1.070s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:44 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Created reservations ['4a3c023a-41cb-43fd-aa58-2ae7d75fb561', '4b636f2b-b336-4aa8-a44d-2a7c1314e86c', 'c1bd1afc-a744-432a-9639-9aef8914219f', 'b195913a-0ea6-4b56-af6a-84b15420da6b'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:32:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.230s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:45 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:32:45 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Deleted volume successfully.
Sep 24 18:32:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "cinder-2e9eb615-4d10-4c07-97b7-235e67d8d1aa-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d5f7f9b6-e708-405e-a30a-9f153e0f2cd4 tempest-AttachVolumeNegativeTest-1266788567 None] Lock "cinder-161018bf-9fba-431a-b1ba-1582a1587df7-delete_volume" released by "delete_volume" :: held 2.750s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Lock "cinder-2e9eb615-4d10-4c07-97b7-235e67d8d1aa-delete_volume" acquired by "delete_volume" :: waited 0.172s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:46 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:32:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "cinder-quobyte-2e9eb615-4d10-4c07-97b7-235e67d8d1aa" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:32:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Lock "cinder-quobyte-2e9eb615-4d10-4c07-97b7-235e67d8d1aa" acquired by "delete_volume" :: waited 0.100s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:32:46 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[dcf277c2-86c4-42fb-893a-00cd7d5aeb49]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:32:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:47 devstack quobyte-client[84204]: System call of process 95079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:47 devstack quobyte-client[84204]: System call of process 95079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:47 devstack quobyte-client[84204]: System call of process 95079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:47 devstack quobyte-client[84204]: System call of process 95079 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:32:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa" returned: 0 in 1.101s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2e9eb615-4d10-4c07-97b7-235e67d8d1aa" returned: 0 in 0.246s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Lock "cinder-quobyte-2e9eb615-4d10-4c07-97b7-235e67d8d1aa" released by "delete_volume" :: held 1.733s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:48 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Created reservations ['7c0ea446-b23e-4a9c-9cae-ee93253547a0', '39d612d2-c299-4fca-9a4e-a0f67e9c289c', 'b9206ee5-0d7c-472b-b1bf-e2e9d237b9c7', '07f143a8-9a77-4c06-8b56-fd60606a8a3b'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:32:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:32:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:32:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:32:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:32:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:32:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:32:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.257s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:32:49 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:32:49 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Deleted volume successfully.
Sep 24 18:32:50 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b9e51f37-0ffb-40e0-b46c-e29462bec5fa tempest-AttachVolumeNegativeTest-1266788567 None] Lock "cinder-2e9eb615-4d10-4c07-97b7-235e67d8d1aa-delete_volume" released by "delete_volume" :: held 4.240s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:32:59 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=17,cinder:UPDATE=18,cinder:INSERT=8,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:32:59 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=31,cinder:SELECT=18,cinder:INSERT=4,cinder:DELETE=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:33:01 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:01 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Flow 'volume_create_manager' (80475b24-b971-46d9-81b7-3a37232f0ccc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528a3dc5-7012-4261-87af-79313b071ce5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (528a3dc5-7012-4261-87af-79313b071ce5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-468972747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3607af88-c53c-43c2-b993-a7eac76e9574,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f88fb761a36443029ff07fd06540d261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:01Z,use_quota=True,user_id='f3c45b71a0024f439657c74306d15e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13011ce2-2e1a-4be3-86eb-f0d5b85ae963) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (13011ce2-2e1a-4be3-86eb-f0d5b85ae963) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9bd2f2-3177-4e79-a587-911af303be07) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (dc9bd2f2-3177-4e79-a587-911af303be07) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3607af88-c53c-43c2-b993-a7eac76e9574', 'volume_name': 'volume-3607af88-c53c-43c2-b993-a7eac76e9574', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1978775f-9aec-448b-91fc-2b4b6344bde2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1978775f-9aec-448b-91fc-2b4b6344bde2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0281ae-db52-40fa-b008-814ec7420239) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:01 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Volume 3607af88-c53c-43c2-b993-a7eac76e9574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3607af88-c53c-43c2-b993-a7eac76e9574', 'volume_size': 1}
Sep 24 18:33:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:11 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:33:11 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:33:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:33:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.162s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 54.208s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] Uploaded volume to glance image-id: d8c1ad0b-57ef-433b-b740-4f0614b15790. {{(pid=84177) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 45.387s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:32:39Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1731617953',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=45cd834f-17c9-4405-abc7-3132436ae5b1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41092410554844869767a4abe96f3878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:32:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:32:40Z,use_quota=True,user_id='22f6f3d1b0474391bc0827e7f17c02e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Creating volume 45cd834f-17c9-4405-abc7-3132436ae5b1 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:25 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-45cd834f-17c9-4405-abc7-3132436ae5b1 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:25 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=71, name=volume-45cd834f-17c9-4405-abc7-3132436ae5b1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:33:25 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-8931ac4e-afdd-4d9a-8bea-34f155a189e8 tempest-VolumesActionsTest-722078092 None] Copy volume to image completed successfully.
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-45cd834f-17c9-4405-abc7-3132436ae5b1 1073741824" returned: 0 in 0.429s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-45cd834f-17c9-4405-abc7-3132436ae5b1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-45cd834f-17c9-4405-abc7-3132436ae5b1" returned: 0 in 0.088s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] <== create_volume: return (569ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.590s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 24.681s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:00Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-468972747',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3607af88-c53c-43c2-b993-a7eac76e9574,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f88fb761a36443029ff07fd06540d261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:01Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:01Z,use_quota=True,user_id='f3c45b71a0024f439657c74306d15e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Creating volume 3607af88-c53c-43c2-b993-a7eac76e9574 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:26 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3607af88-c53c-43c2-b993-a7eac76e9574 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:26 devstack quobyte-client[84204]: System call of process 95136 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:26 devstack quobyte-client[84204]: System call of process 95136 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:26 devstack quobyte-client[84204]: System call of process 95136 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:26 devstack quobyte-client[84204]: System call of process 95136 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:26 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=72, name=volume-3607af88-c53c-43c2-b993-a7eac76e9574, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (21fcecfe-3951-4d08-a2f9-c24b0d911022) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-45cd834f-17c9-4405-abc7-3132436ae5b1', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff8a0c8-bd44-4b68-b292-37cb6e6b3248) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3607af88-c53c-43c2-b993-a7eac76e9574 1073741824" returned: 0 in 0.529s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3607af88-c53c-43c2-b993-a7eac76e9574 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:26 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Volume volume-45cd834f-17c9-4405-abc7-3132436ae5b1 (45cd834f-17c9-4405-abc7-3132436ae5b1): created successfully
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (eff8a0c8-bd44-4b68-b292-37cb6e6b3248) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Flow 'volume_create_manager' (93893cdf-9b98-4ccb-89d6-2385fea263e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3607af88-c53c-43c2-b993-a7eac76e9574" returned: 0 in 0.399s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] <== create_volume: return (964ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:33:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.988s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:26 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-7ac40031-dac5-495f-9964-6d2855b7b75e tempest-VolumesListAdminTestJSON-995087691 None] Created volume successfully.
Sep 24 18:33:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed0281ae-db52-40fa-b008-814ec7420239) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3607af88-c53c-43c2-b993-a7eac76e9574', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796b7e06-8bec-4f6b-a1af-ba3f663ade11) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:27 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Volume volume-3607af88-c53c-43c2-b993-a7eac76e9574 (3607af88-c53c-43c2-b993-a7eac76e9574): created successfully
Sep 24 18:33:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (796b7e06-8bec-4f6b-a1af-ba3f663ade11) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:27 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Flow 'volume_create_manager' (80475b24-b971-46d9-81b7-3a37232f0ccc) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:27 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-def2bf9c-dd92-4dc6-bd76-da72e0334497 tempest-VolumesTestJSON-1028751739 None] Created volume successfully.
Sep 24 18:33:27 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:27 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0238b96e-fbae-432d-bdca-dbd57f106cc4]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:27 devstack quobyte-client[84204]: System call of process 95140 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:27 devstack quobyte-client[84204]: System call of process 95140 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d" returned: 0 in 0.518s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c416f3af-8409-4147-8f81-d1f675684dde]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:28 devstack quobyte-client[84204]: System call of process 95143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:28 devstack quobyte-client[84204]: System call of process 95143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:28 devstack quobyte-client[84204]: System call of process 95143 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:28 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Flow 'volume_create_manager' (7f646e20-7424-4f09-b0d1-8d8f2c6b6719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0250905a-4909-4819-9f44-b16efa255e71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:28 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Flow 'volume_create_manager' (62300c03-67e5-4615-92ab-2de1b665f598) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac1ed75-8067-49cf-a244-4ab2adea99ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fac1ed75-8067-49cf-a244-4ab2adea99ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1332546779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19537c56-4a1a-46b6-93e4-1860002ce8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41092410554844869767a4abe96f3878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:28Z,use_quota=True,user_id='22f6f3d1b0474391bc0827e7f17c02e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfe1c09-f8b0-4046-92ed-a06f8912b901) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (cbfe1c09-f8b0-4046-92ed-a06f8912b901) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cba7bed-4d6a-4a1e-9747-17cf448b6c13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0cba7bed-4d6a-4a1e-9747-17cf448b6c13) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '19537c56-4a1a-46b6-93e4-1860002ce8d5', 'volume_name': 'volume-19537c56-4a1a-46b6-93e4-1860002ce8d5', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9432e474-23fe-40e1-ae70-0431eba08870) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9432e474-23fe-40e1-ae70-0431eba08870) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccc6a55-8960-457c-8ae5-2c13654e87ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:28 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Volume 19537c56-4a1a-46b6-93e4-1860002ce8d5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-19537c56-4a1a-46b6-93e4-1860002ce8d5', 'volume_size': 1}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0250905a-4909-4819-9f44-b16efa255e71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1519543226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db3def5-a96b-4194-a602-a72a82c20993,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f88fb761a36443029ff07fd06540d261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:28Z,use_quota=True,user_id='f3c45b71a0024f439657c74306d15e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f441f99e-5fca-4022-9906-f2a922f9c762) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f441f99e-5fca-4022-9906-f2a922f9c762) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059d9128-e467-466f-a780-49cb2298ece8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (059d9128-e467-466f-a780-49cb2298ece8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9db3def5-a96b-4194-a602-a72a82c20993', 'volume_name': 'volume-9db3def5-a96b-4194-a602-a72a82c20993', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fc3734-7327-46a0-9743-209fc3b69bc4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (12fc3734-7327-46a0-9743-209fc3b69bc4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bbe8ec-98fe-4412-9ff4-c5fa928aa624) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:28 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Volume 9db3def5-a96b-4194-a602-a72a82c20993: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9db3def5-a96b-4194-a602-a72a82c20993', 'volume_size': 1}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d" returned: 0 in 0.826s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8a4yb2n2u.img {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:29 devstack quobyte-client[84204]: System call of process 95147 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] CMD "qemu-img convert -O raw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8a4yb2n2u.img" returned: 0 in 5.610s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:34 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[241ba0b2-34ff-4945-a8be-8138d47beced]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d" returned: 0 in 0.592s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:35 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d, size 1024.00 MB, duration 5.64 sec, destination /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8a4yb2n2u.img {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:33:35 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Converted 1024.00 MB image at 181.68 MB/s
Sep 24 18:33:35 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8 was raw, converting to qcow2 {{(pid=84177) upload_volume /opt/stack/cinder/cinder/image/image_utils.py:1144}}
Sep 24 18:33:35 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bd60d3f8-a4c9-4e75-a38a-187e8f4de568]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8a4yb2n2u.img {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8a4yb2n2u.img" returned: 0 in 0.331s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8a4yb2n2u.img {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8a4yb2n2u.img" returned: 1 in 0.352s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8a4yb2n2u.img' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:33:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8a4yb2n2u.img /opt/stack/data/cinder/conversion/vol_upload_htxiiso_ {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] CMD "qemu-img convert -O qcow2 -c /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8a4yb2n2u.img /opt/stack/data/cinder/conversion/vol_upload_htxiiso_" returned: 0 in 0.150s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:36 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Image conversion details: src /opt/stack/data/cinder/conversion/a4094971-2a69-49d5-a618-38fdc031274d.temp_image.dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8a4yb2n2u.img, size 1024.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/conversion/vol_upload_htxiiso_ {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:33:36 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Converted 1024.00 MB image at 1024.00 MB/s
Sep 24 18:33:36 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[81da32b6-c761-42e8-97b2-461f2cb7216b]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_htxiiso_ {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/vol_upload_htxiiso_" returned: 0 in 0.333s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.copy_volume_to_image" :: held 10.668s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Uploaded volume to glance image-id: dd0c624e-9cf5-40c2-8eb0-fbfc4c1141e8. {{(pid=84177) copy_volume_to_image /opt/stack/cinder/cinder/volume/manager.py:1780}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.258s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1332546779',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=19537c56-4a1a-46b6-93e4-1860002ce8d5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41092410554844869767a4abe96f3878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:28Z,use_quota=True,user_id='22f6f3d1b0474391bc0827e7f17c02e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Creating volume 19537c56-4a1a-46b6-93e4-1860002ce8d5 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:38 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-19537c56-4a1a-46b6-93e4-1860002ce8d5 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:38 devstack quobyte-client[84204]: System call of process 95174 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:38 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=73, name=volume-19537c56-4a1a-46b6-93e4-1860002ce8d5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:33:38 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-51187121-1cec-4974-bbbd-02c7f64b3d09 tempest-VolumesActionsTest-722078092 None] Copy volume to image completed successfully.
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-19537c56-4a1a-46b6-93e4-1860002ce8d5 1073741824" returned: 0 in 0.461s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-19537c56-4a1a-46b6-93e4-1860002ce8d5 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-19537c56-4a1a-46b6-93e4-1860002ce8d5" returned: 0 in 0.080s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] <== create_volume: return (594ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.615s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 9.966s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-1519543226',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9db3def5-a96b-4194-a602-a72a82c20993,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f88fb761a36443029ff07fd06540d261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:28Z,use_quota=True,user_id='f3c45b71a0024f439657c74306d15e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Creating volume 9db3def5-a96b-4194-a602-a72a82c20993 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:38 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:33:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9db3def5-a96b-4194-a602-a72a82c20993 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:39 devstack quobyte-client[84204]: System call of process 95178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:39 devstack quobyte-client[84204]: System call of process 95178 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:39 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=74, name=volume-9db3def5-a96b-4194-a602-a72a82c20993, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4ccc6a55-8960-457c-8ae5-2c13654e87ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-19537c56-4a1a-46b6-93e4-1860002ce8d5', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168fb191-3f74-4d6a-b7f6-77a6b3ff7d5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:39 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Volume volume-19537c56-4a1a-46b6-93e4-1860002ce8d5 (19537c56-4a1a-46b6-93e4-1860002ce8d5): created successfully
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (168fb191-3f74-4d6a-b7f6-77a6b3ff7d5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Flow 'volume_create_manager' (62300c03-67e5-4615-92ab-2de1b665f598) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9db3def5-a96b-4194-a602-a72a82c20993 1073741824" returned: 0 in 0.417s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9db3def5-a96b-4194-a602-a72a82c20993 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:39 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-9c78b4dc-7a49-4e92-afb0-716f5a813509 tempest-VolumesListAdminTestJSON-995087691 None] Created volume successfully.
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9db3def5-a96b-4194-a602-a72a82c20993" returned: 0 in 0.330s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] <== create_volume: return (782ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.800s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (56bbe8ec-98fe-4412-9ff4-c5fa928aa624) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9db3def5-a96b-4194-a602-a72a82c20993', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc65f5a-98dc-427d-bd0a-63859c7203c9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:39 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Volume volume-9db3def5-a96b-4194-a602-a72a82c20993 (9db3def5-a96b-4194-a602-a72a82c20993): created successfully
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2bc65f5a-98dc-427d-bd0a-63859c7203c9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Flow 'volume_create_manager' (7f646e20-7424-4f09-b0d1-8d8f2c6b6719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:39 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-f68583b4-ee66-41a3-97ef-2d67358ace24 tempest-VolumesTestJSON-1028751739 None] Created volume successfully.
Sep 24 18:33:40 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Flow 'volume_create_manager' (a8a8d3a6-4d56-4e63-8a6d-086118471331) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe906ca-73e1-4c86-8eb2-743e56e3bf32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (abe906ca-73e1-4c86-8eb2-743e56e3bf32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1458085576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b12ffbe-6643-456b-8a7e-c0ddf3ccada2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41092410554844869767a4abe96f3878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:40Z,use_quota=True,user_id='22f6f3d1b0474391bc0827e7f17c02e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4c4fb5-4c39-46a1-98a5-e9146dd8150b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (af4c4fb5-4c39-46a1-98a5-e9146dd8150b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72aac682-d9e4-4fc4-8d08-7f636c096b14) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (72aac682-d9e4-4fc4-8d08-7f636c096b14) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8b12ffbe-6643-456b-8a7e-c0ddf3ccada2', 'volume_name': 'volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a93fe0-9cd8-4d6f-94fd-a4b32c344544) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33a93fe0-9cd8-4d6f-94fd-a4b32c344544) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eda3546-3ab1-4ca5-b559-bc0d1db8fe70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:40 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Volume 8b12ffbe-6643-456b-8a7e-c0ddf3ccada2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2', 'volume_size': 1}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:40Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListAdminTestJSON-Volume-1458085576',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8b12ffbe-6643-456b-8a7e-c0ddf3ccada2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='41092410554844869767a4abe96f3878',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:40Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:40Z,use_quota=True,user_id='22f6f3d1b0474391bc0827e7f17c02e3',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Creating volume 8b12ffbe-6643-456b-8a7e-c0ddf3ccada2 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:40 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:40 devstack quobyte-client[84204]: System call of process 95183 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:40 devstack quobyte-client[84204]: System call of process 95183 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:40 devstack quobyte-client[84204]: System call of process 95183 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:40 devstack quobyte-client[84204]: System call of process 95183 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:40 devstack quobyte-client[84204]: System call of process 95183 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:40 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=75, name=volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Acquiring lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:40 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d-delete_volume" acquired by "delete_volume" :: waited 0.144s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2 1073741824" returned: 0 in 0.561s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2" returned: 0 in 0.382s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:41 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Acquiring lock "cinder-quobyte-a4094971-2a69-49d5-a618-38fdc031274d" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] <== create_volume: return (1022ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.030s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3eda3546-3ab1-4ca5-b559-bc0d1db8fe70) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9cf32f-2ff0-4b0d-95ab-571daf53e013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Lock "cinder-quobyte-a4094971-2a69-49d5-a618-38fdc031274d" acquired by "delete_volume" :: waited 0.159s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:41 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Volume volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2 (8b12ffbe-6643-456b-8a7e-c0ddf3ccada2): created successfully
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (cd9cf32f-2ff0-4b0d-95ab-571daf53e013) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Flow 'volume_create_manager' (a8a8d3a6-4d56-4e63-8a6d-086118471331) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7c3bcdff-f1b8-44ed-916b-1a42e4b12543]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:41 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-c203b32b-7a98-4afd-93d8-a699ddd1be52 tempest-VolumesListAdminTestJSON-995087691 None] Created volume successfully.
Sep 24 18:33:42 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Flow 'volume_create_manager' (fb50dfe3-561c-48fc-84dc-83e62d68449a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c6d1e6-39e3-4129-9c00-2ed88016f080) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (84c6d1e6-39e3-4129-9c00-2ed88016f080) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-548592339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32b38a8-ef4c-4988-ae94-acccfbc1a463,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f88fb761a36443029ff07fd06540d261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:41Z,use_quota=True,user_id='f3c45b71a0024f439657c74306d15e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b84271a-e190-470f-a220-8d6d5aaa2c52) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b84271a-e190-470f-a220-8d6d5aaa2c52) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c724c9-bebd-455b-9f86-fa53458ed0f4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (92c724c9-bebd-455b-9f86-fa53458ed0f4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a32b38a8-ef4c-4988-ae94-acccfbc1a463', 'volume_name': 'volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bec2d59-7343-405b-9853-03c344105809) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:42 devstack quobyte-client[84204]: System call of process 95187 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bec2d59-7343-405b-9853-03c344105809) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f2cb0f-9127-43dc-97a5-cdd2556ada67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:42 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Volume a32b38a8-ef4c-4988-ae94-acccfbc1a463: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463', 'volume_size': 1}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:41Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTestJSON-volume-548592339',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a32b38a8-ef4c-4988-ae94-acccfbc1a463,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='f88fb761a36443029ff07fd06540d261',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:41Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:41Z,use_quota=True,user_id='f3c45b71a0024f439657c74306d15e7b',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Creating volume a32b38a8-ef4c-4988-ae94-acccfbc1a463 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.048s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:42 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:42 devstack quobyte-client[84204]: System call of process 95190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:42 devstack quobyte-client[84204]: System call of process 95190 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d" returned: 0 in 0.805s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:42 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=76, name=volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a4094971-2a69-49d5-a618-38fdc031274d" returned: 0 in 0.171s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Lock "cinder-quobyte-a4094971-2a69-49d5-a618-38fdc031274d" released by "delete_volume" :: held 1.241s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463 1073741824" returned: 0 in 0.755s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463" returned: 0 in 0.371s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] <== create_volume: return (1208ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.221s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:43 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Flow 'volume_create_manager' (b13796e7-dbee-4a0e-a5cc-fb67f05a101c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021e50bf-e5ac-4bfa-a5ce-117d31e5d705) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (021e50bf-e5ac-4bfa-a5ce-117d31e5d705) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997e90ad-bc8f-4c3c-bd44-93982e1f6eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3371420b0aba4ce5b5d3c9b7deb3ad6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:43Z,use_quota=True,user_id='31bda06621164f2ba6f9fad6a7f21c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bc0ff0-ac85-4847-b459-62109da05b2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f3bc0ff0-ac85-4847-b459-62109da05b2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baef50e1-ea8f-4ce9-ad8e-e10b1075d99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (baef50e1-ea8f-4ce9-ad8e-e10b1075d99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '997e90ad-bc8f-4c3c-bd44-93982e1f6eea', 'volume_name': 'volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35efaba-d305-4e8b-b1d0-840cd73542c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (d35efaba-d305-4e8b-b1d0-840cd73542c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d89bec1f-c13a-4ac9-a84d-2b8e453ab10c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:43 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Volume 997e90ad-bc8f-4c3c-bd44-93982e1f6eea: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea', 'volume_size': 1}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata={},attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:33:43Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=997e90ad-bc8f-4c3c-bd44-93982e1f6eea,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3371420b0aba4ce5b5d3c9b7deb3ad6b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:33:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:33:43Z,use_quota=True,user_id='31bda06621164f2ba6f9fad6a7f21c41',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Creating volume 997e90ad-bc8f-4c3c-bd44-93982e1f6eea {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:33:43 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:33:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:43 devstack quobyte-client[84204]: System call of process 95195 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:43 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=77, name=volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Created reservations ['eb86571c-e6ab-4883-870d-57aa01a2d86a', '85ff172c-ab26-46ff-a667-3ae65eb07bf1', 'c0fad24b-64a2-4d06-add3-7485ffa5feab', 'c40fdd93-d7a8-4ef3-96ac-fa635d6d0e83'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (25f2cb0f-9127-43dc-97a5-cdd2556ada67) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195c9914-30cd-45a7-b13f-64a7f0155c4d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea 1073741824" returned: 0 in 0.464s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:44 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Volume volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463 (a32b38a8-ef4c-4988-ae94-acccfbc1a463): created successfully
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (195c9914-30cd-45a7-b13f-64a7f0155c4d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Flow 'volume_create_manager' (fb50dfe3-561c-48fc-84dc-83e62d68449a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea" returned: 0 in 0.345s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] <== create_volume: return (831ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.839s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:44 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-0bdc0393-604e-4ece-9c43-8cf3c5e98972 tempest-VolumesTestJSON-1028751739 None] Created volume successfully.
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d89bec1f-c13a-4ac9-a84d-2b8e453ab10c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee130e4-c52f-45eb-8adc-d85461e2c774) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:33:44 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Volume volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea (997e90ad-bc8f-4c3c-bd44-93982e1f6eea): created successfully
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fee130e4-c52f-45eb-8adc-d85461e2c774) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Flow 'volume_create_manager' (b13796e7-dbee-4a0e-a5cc-fb67f05a101c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:45 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b1685b39-b0bf-43c3-9e86-8f75a6cb2b55 tempest-VolumesListAdminTestJSON-976303785 None] Created volume successfully.
Sep 24 18:33:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.511s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:45 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:45 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Deleted volume successfully.
Sep 24 18:33:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-fdb366df-ce6a-4fef-9dd3-6c99fc5dc7c6 tempest-VolumesActionsTest-722078092 None] Lock "cinder-a4094971-2a69-49d5-a618-38fdc031274d-delete_volume" released by "delete_volume" :: held 4.716s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Acquiring lock "cinder-997e90ad-bc8f-4c3c-bd44-93982e1f6eea-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Lock "cinder-997e90ad-bc8f-4c3c-bd44-93982e1f6eea-delete_volume" acquired by "delete_volume" :: waited 0.065s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "cinder-a32b38a8-ef4c-4988-ae94-acccfbc1a463-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Lock "cinder-a32b38a8-ef4c-4988-ae94-acccfbc1a463-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:46 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Acquiring lock "cinder-quobyte-997e90ad-bc8f-4c3c-bd44-93982e1f6eea" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "cinder-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:46 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "cinder-quobyte-a32b38a8-ef4c-4988-ae94-acccfbc1a463" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Lock "cinder-quobyte-997e90ad-bc8f-4c3c-bd44-93982e1f6eea" acquired by "delete_volume" :: waited 0.110s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Lock "cinder-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2-delete_volume" acquired by "delete_volume" :: waited 0.103s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[47154886-90d2-474e-9ff7-dad5de3662c8]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Lock "cinder-quobyte-a32b38a8-ef4c-4988-ae94-acccfbc1a463" acquired by "delete_volume" :: waited 0.208s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c747f48e-0379-44e2-a6bf-65fa59d1230e]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:47 devstack quobyte-client[84204]: System call of process 95200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:47 devstack quobyte-client[84204]: System call of process 95200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:47 devstack quobyte-client[84204]: System call of process 95200 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:47 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:47 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "cinder-quobyte-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea" returned: 0 in 1.260s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Lock "cinder-quobyte-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2" acquired by "delete_volume" :: waited 0.415s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463" returned: 0 in 1.149s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:48 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b31f8042-cd3b-4e2d-827e-725a792289aa]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-997e90ad-bc8f-4c3c-bd44-93982e1f6eea" returned: 0 in 0.468s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Lock "cinder-quobyte-997e90ad-bc8f-4c3c-bd44-93982e1f6eea" released by "delete_volume" :: held 2.452s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:49 devstack quobyte-client[84204]: System call of process 95209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:49 devstack quobyte-client[84204]: System call of process 95209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:49 devstack quobyte-client[84204]: System call of process 95209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:49 devstack quobyte-client[84204]: System call of process 95209 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a32b38a8-ef4c-4988-ae94-acccfbc1a463" returned: 0 in 1.371s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2" returned: 0 in 1.255s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:49 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Lock "cinder-quobyte-a32b38a8-ef4c-4988-ae94-acccfbc1a463" released by "delete_volume" :: held 2.900s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2" returned: 0 in 0.669s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:50 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Lock "cinder-quobyte-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2" released by "delete_volume" :: held 2.426s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:50 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Created reservations ['93488d0a-5ac3-4a4b-ac75-b09d47c38c58', '4d332f6b-e730-4d81-a9e9-bac10fb756fb', 'f96f5f30-d2ea-44de-b3e5-0287d7dc2aa2', '10d187a0-2b5e-419c-a8be-1f4ba8d748b7'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:50 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Created reservations ['ce6da2cb-e395-467e-8a5d-b68a83f7d0e8', 'cc8e4cc4-3ae1-45a2-b510-5351cc2d1306', 'd11aa381-abd8-48a9-a844-66507f714efc', '6601c5c4-91f2-4b5c-a8af-186926a0e8b9'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.367s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:51 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:51 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Created reservations ['1d55ee93-6eee-4fa8-b6d2-bad70a1728fb', 'bfe3c4df-5899-4989-a504-005230c0b5cf', 'f5060e55-594f-487b-b27e-c292fc1072a9', 'e99fea3c-295d-43f2-b82f-c2e2e0ad5480'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:51 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Deleted volume successfully.
Sep 24 18:33:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "cinder-9db3def5-a96b-4194-a602-a72a82c20993-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-25d3fe01-e701-47e7-a200-58fe69ef9527 tempest-VolumesTestJSON-1028751739 None] Lock "cinder-a32b38a8-ef4c-4988-ae94-acccfbc1a463-delete_volume" released by "delete_volume" :: held 5.388s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Lock "cinder-9db3def5-a96b-4194-a602-a72a82c20993-delete_volume" acquired by "delete_volume" :: waited 0.255s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.457s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:52 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Deleted volume successfully.
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "cinder-19537c56-4a1a-46b6-93e4-1860002ce8d5-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:52 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "cinder-quobyte-9db3def5-a96b-4194-a602-a72a82c20993" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.621s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ea24504b-0b49-484f-98fe-221daf5ab2ee tempest-VolumesListAdminTestJSON-976303785 None] Lock "cinder-997e90ad-bc8f-4c3c-bd44-93982e1f6eea-delete_volume" released by "delete_volume" :: held 6.685s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:52 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Deleted volume successfully.
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Lock "cinder-19537c56-4a1a-46b6-93e4-1860002ce8d5-delete_volume" acquired by "delete_volume" :: waited 0.107s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Lock "cinder-quobyte-9db3def5-a96b-4194-a602-a72a82c20993" acquired by "delete_volume" :: waited 0.091s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[98918d7d-7a70-4c7e-9d3c-a769de494e95]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9db3def5-a96b-4194-a602-a72a82c20993 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "cinder-quobyte-19537c56-4a1a-46b6-93e4-1860002ce8d5" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-20ed8b79-3f33-4759-9a5c-fcc9005d442a tempest-VolumesListAdminTestJSON-995087691 None] Lock "cinder-8b12ffbe-6643-456b-8a7e-c0ddf3ccada2-delete_volume" released by "delete_volume" :: held 7.099s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Lock "cinder-quobyte-19537c56-4a1a-46b6-93e4-1860002ce8d5" acquired by "delete_volume" :: waited 0.056s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:53 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a47347-76fc-4198-b7bf-878507b5c4cc]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-19537c56-4a1a-46b6-93e4-1860002ce8d5 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9db3def5-a96b-4194-a602-a72a82c20993" returned: 0 in 0.916s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9db3def5-a96b-4194-a602-a72a82c20993 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9db3def5-a96b-4194-a602-a72a82c20993" returned: 0 in 0.180s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:54 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Lock "cinder-quobyte-9db3def5-a96b-4194-a602-a72a82c20993" released by "delete_volume" :: held 1.398s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-19537c56-4a1a-46b6-93e4-1860002ce8d5" returned: 0 in 0.879s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-19537c56-4a1a-46b6-93e4-1860002ce8d5 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-19537c56-4a1a-46b6-93e4-1860002ce8d5" returned: 0 in 0.259s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:54 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Lock "cinder-quobyte-19537c56-4a1a-46b6-93e4-1860002ce8d5" released by "delete_volume" :: held 1.290s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Created reservations ['1239f14b-109b-48d4-8b2a-55b5128b4e94', '98181f57-d37a-4c0a-93a4-73e7d44c4517', 'c1dc7b94-205c-4528-9593-3bfa6446c9d0', '3a44e754-de2c-4fb5-aea9-98e66e509e26'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Created reservations ['8f7549fd-ac14-452c-aab6-d0afa3649f47', 'c07578d7-1671-4b9d-b424-c6d7b190cbf5', 'bc7a9e5c-f252-4839-bef3-e2b9022bf98c', 'b677534f-f424-4f12-9acc-61860296ea80'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.223s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:55 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Deleted volume successfully.
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9ae32634-8f3d-41e9-b198-48d094bc029e tempest-VolumesListAdminTestJSON-995087691 None] Lock "cinder-19537c56-4a1a-46b6-93e4-1860002ce8d5-delete_volume" released by "delete_volume" :: held 3.045s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.239s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:56 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:56 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Deleted volume successfully.
Sep 24 18:33:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-00400791-4e42-42c1-acd0-b949ead8b375 tempest-VolumesTestJSON-1028751739 None] Lock "cinder-9db3def5-a96b-4194-a602-a72a82c20993-delete_volume" released by "delete_volume" :: held 4.398s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "cinder-3607af88-c53c-43c2-b993-a7eac76e9574-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Lock "cinder-3607af88-c53c-43c2-b993-a7eac76e9574-delete_volume" acquired by "delete_volume" :: waited 0.031s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "cinder-45cd834f-17c9-4405-abc7-3132436ae5b1-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Lock "cinder-45cd834f-17c9-4405-abc7-3132436ae5b1-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:56 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "cinder-quobyte-3607af88-c53c-43c2-b993-a7eac76e9574" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:56 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:33:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "cinder-quobyte-45cd834f-17c9-4405-abc7-3132436ae5b1" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:33:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Lock "cinder-quobyte-3607af88-c53c-43c2-b993-a7eac76e9574" acquired by "delete_volume" :: waited 0.036s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:56 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[cf6b686d-2677-44b2-b672-ba81e56c3d0a]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3607af88-c53c-43c2-b993-a7eac76e9574 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Lock "cinder-quobyte-45cd834f-17c9-4405-abc7-3132436ae5b1" acquired by "delete_volume" :: waited 0.202s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:33:57 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[be1c1228-7ca3-4301-8720-5bbbeb7cf387]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:33:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-45cd834f-17c9-4405-abc7-3132436ae5b1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:57 devstack quobyte-client[84204]: System call of process 95265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:57 devstack quobyte-client[84204]: System call of process 95265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:57 devstack quobyte-client[84204]: System call of process 95265 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3607af88-c53c-43c2-b993-a7eac76e9574" returned: 0 in 0.607s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3607af88-c53c-43c2-b993-a7eac76e9574 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3607af88-c53c-43c2-b993-a7eac76e9574" returned: 0 in 0.142s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:57 devstack quobyte-client[84204]: System call of process 95266 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:33:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Lock "cinder-quobyte-3607af88-c53c-43c2-b993-a7eac76e9574" released by "delete_volume" :: held 1.022s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-45cd834f-17c9-4405-abc7-3132436ae5b1" returned: 0 in 0.914s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-45cd834f-17c9-4405-abc7-3132436ae5b1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-45cd834f-17c9-4405-abc7-3132436ae5b1" returned: 0 in 0.233s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Lock "cinder-quobyte-45cd834f-17c9-4405-abc7-3132436ae5b1" released by "delete_volume" :: held 1.418s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:58 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Created reservations ['6bc06d53-2786-491b-993c-c0dc83d53d84', '7078a03d-fcdd-4c55-ae8c-2bd778a44a21', 'ad2382db-c249-4f7b-a1c6-6e6b7249768e', 'c160c25d-1222-4806-8b6d-e8bc0769d677'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.198s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:58 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:58 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Deleted volume successfully.
Sep 24 18:33:58 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Created reservations ['e972b221-0a83-4fb1-9a53-c4e8786f77af', '5c4522ad-351a-4d42-9201-4abebf6f0e06', '203d15aa-09a2-4300-9e43-22e0744713c1', '68e61310-544b-4729-8cab-5c74beca8fff'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:33:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-722f3899-d63b-4043-b958-14431046af75 tempest-VolumesTestJSON-1028751739 None] Lock "cinder-3607af88-c53c-43c2-b993-a7eac76e9574-delete_volume" released by "delete_volume" :: held 2.757s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:33:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:33:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:33:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:33:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:33:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:33:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:33:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.198s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:33:59 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:33:59 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Deleted volume successfully.
Sep 24 18:33:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6b166665-61b8-44bd-a993-b5380ec9713b tempest-VolumesListAdminTestJSON-995087691 None] Lock "cinder-45cd834f-17c9-4405-abc7-3132436ae5b1-delete_volume" released by "delete_volume" :: held 3.296s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:04 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-727e9664-950c-44d6-a531-8f9f1c6afaa2 tempest-GroupsTest-1619064466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:04 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-727e9664-950c-44d6-a531-8f9f1c6afaa2 tempest-GroupsTest-1619064466 None] Group tempest-Group1-120174332: creating
Sep 24 18:34:04 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:04 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Flow 'volume_create_manager' (465dafe9-1af7-4da9-8eff-8cef751b6b2d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103d441e-ccba-4fa6-87ee-ccc637d4d1d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (103d441e-ccba-4fa6-87ee-ccc637d4d1d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1839929181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a7f009-0bb3-4814-bc60-3013ce83b30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775d3e3981a54bb1adf394f64e41add8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:05Z,use_quota=True,user_id='b269dd7255b7420fb6045da74838c9b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367fafb9-048e-434d-8bff-720c5d7c40e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (367fafb9-048e-434d-8bff-720c5d7c40e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b8178a-3367-4279-ba76-4cf5e8b1f020) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (23b8178a-3367-4279-ba76-4cf5e8b1f020) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '97a7f009-0bb3-4814-bc60-3013ce83b30d', 'volume_name': 'volume-97a7f009-0bb3-4814-bc60-3013ce83b30d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7c0817-0c74-42b9-86b9-6f3fc7112035) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a7c0817-0c74-42b9-86b9-6f3fc7112035) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5562ad2-93c4-44a5-951f-31461f24e785) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:05 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Volume 97a7f009-0bb3-4814-bc60-3013ce83b30d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-97a7f009-0bb3-4814-bc60-3013ce83b30d', 'volume_size': 1}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:04Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesNegativeTest-Volume-1839929181',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=97a7f009-0bb3-4814-bc60-3013ce83b30d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='775d3e3981a54bb1adf394f64e41add8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:05Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:05Z,use_quota=True,user_id='b269dd7255b7420fb6045da74838c9b4',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Creating volume 97a7f009-0bb3-4814-bc60-3013ce83b30d {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:05 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-97a7f009-0bb3-4814-bc60-3013ce83b30d 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:05 devstack quobyte-client[84204]: System call of process 95283 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:05 devstack quobyte-client[84204]: System call of process 95283 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:05 devstack quobyte-client[84204]: System call of process 95283 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:05 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=78, name=volume-97a7f009-0bb3-4814-bc60-3013ce83b30d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:34:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-727e9664-950c-44d6-a531-8f9f1c6afaa2 tempest-GroupsTest-1619064466 None] Group tempest-Group1-120174332: created successfully
Sep 24 18:34:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-727e9664-950c-44d6-a531-8f9f1c6afaa2 tempest-GroupsTest-1619064466 None] Create group completed successfully.
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-97a7f009-0bb3-4814-bc60-3013ce83b30d 1073741824" returned: 0 in 0.616s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-97a7f009-0bb3-4814-bc60-3013ce83b30d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-97a7f009-0bb3-4814-bc60-3013ce83b30d" returned: 0 in 0.157s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] <== create_volume: return (836ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:34:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.853s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a5562ad2-93c4-44a5-951f-31461f24e785) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-97a7f009-0bb3-4814-bc60-3013ce83b30d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43631aa8-b91b-4918-9a51-538d50f4e4c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:06 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-9b564fa6-2c11-47bb-a53c-3d7b704dbb27 tempest-GroupsTest-1619064466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:06 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-9b564fa6-2c11-47bb-a53c-3d7b704dbb27 tempest-GroupsTest-1619064466 None] Group tempest-Group2-268544209: creating
Sep 24 18:34:06 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Volume volume-97a7f009-0bb3-4814-bc60-3013ce83b30d (97a7f009-0bb3-4814-bc60-3013ce83b30d): created successfully
Sep 24 18:34:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (43631aa8-b91b-4918-9a51-538d50f4e4c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Flow 'volume_create_manager' (465dafe9-1af7-4da9-8eff-8cef751b6b2d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:06 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a7acf770-4e8d-4485-810d-046116f86484 tempest-VolumesNegativeTest-1564646578 None] Created volume successfully.
Sep 24 18:34:06 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-9b564fa6-2c11-47bb-a53c-3d7b704dbb27 tempest-GroupsTest-1619064466 None] Group tempest-Group2-268544209: created successfully
Sep 24 18:34:06 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-9b564fa6-2c11-47bb-a53c-3d7b704dbb27 tempest-GroupsTest-1619064466 None] Create group completed successfully.
Sep 24 18:34:08 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Flow 'volume_create_manager' (d103dd7f-749e-43b0-98fe-9e208ae18e06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136bb049-8f7b-4991-8a02-a8df518b5a70) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (136bb049-8f7b-4991-8a02-a8df518b5a70) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1876495971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=981623f2-d9e1-4beb-bbeb-0332a5618250,host='devstack@QuobyteHD#QuobyteHD',id=db7a8b7a-a2bd-48be-ace5-e5772df42ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91156eb599c54c26a367704c2566a1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:08Z,use_quota=True,user_id='5789dda2b53c4f6b991958911ec916a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d4a2621-3661-44bb-9e51-fce312f1f559),volume_type_id=4d4a2621-3661-44bb-9e51-fce312f1f559)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fcb78c-1f37-4e0b-860c-bf4e6b2ecb6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b9fcb78c-1f37-4e0b-860c-bf4e6b2ecb6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b281a7-caf4-4248-bbdf-5bb69b6072d3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (81b281a7-caf4-4248-bbdf-5bb69b6072d3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'db7a8b7a-a2bd-48be-ace5-e5772df42ff2', 'volume_name': 'volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4e5321-6315-4109-a406-79b71be9c539) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (be4e5321-6315-4109-a406-79b71be9c539) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d61434f-b96a-4e0e-ac73-6e8a71083546) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:08 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Volume db7a8b7a-a2bd-48be-ace5-e5772df42ff2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2', 'volume_size': 1}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=981623f2-d9e1-4beb-bbeb-0332a5618250,created_at=2025-09-24T16:34:07Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1876495971',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=981623f2-d9e1-4beb-bbeb-0332a5618250,host='devstack@QuobyteHD#QuobyteHD',id=db7a8b7a-a2bd-48be-ace5-e5772df42ff2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91156eb599c54c26a367704c2566a1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:08Z,use_quota=True,user_id='5789dda2b53c4f6b991958911ec916a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d4a2621-3661-44bb-9e51-fce312f1f559),volume_type_id=4d4a2621-3661-44bb-9e51-fce312f1f559)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Creating volume db7a8b7a-a2bd-48be-ace5-e5772df42ff2 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:08 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:34:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:08 devstack quobyte-client[84204]: System call of process 95287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:08 devstack quobyte-client[84204]: System call of process 95287 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:08 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=79, name=volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2 1073741824" returned: 0 in 0.811s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2" returned: 0 in 0.344s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] <== create_volume: return (1214ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.225s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:09 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Flow 'volume_create_manager' (efe8e33f-b31c-4650-8fdd-cdf2420e38c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c99ec9-fad5-4164-a914-c24133871471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (40c99ec9-fad5-4164-a914-c24133871471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1869800217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368150a7-95b9-424e-99d3-b93b533f2a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e516f0436a447798c0fde842a149a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:09Z,use_quota=True,user_id='bedf26b8d08a4b0ba73b91ecbfe988af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c837cf8-3022-4d43-b7df-e5052b72d7c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c837cf8-3022-4d43-b7df-e5052b72d7c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc0f235-e102-4978-8093-3c1aad94a531) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8bc0f235-e102-4978-8093-3c1aad94a531) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '368150a7-95b9-424e-99d3-b93b533f2a86', 'volume_name': 'volume-368150a7-95b9-424e-99d3-b93b533f2a86', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25dca4d0-3878-4d9a-ae14-bd26dc0a5eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (25dca4d0-3878-4d9a-ae14-bd26dc0a5eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7753100f-5d2a-46e6-a105-0e450803878a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:09 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Volume 368150a7-95b9-424e-99d3-b93b533f2a86: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-368150a7-95b9-424e-99d3-b93b533f2a86', 'volume_size': 1}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-1869800217',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=368150a7-95b9-424e-99d3-b93b533f2a86,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e516f0436a447798c0fde842a149a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:09Z,use_quota=True,user_id='bedf26b8d08a4b0ba73b91ecbfe988af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Creating volume 368150a7-95b9-424e-99d3-b93b533f2a86 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:09 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:34:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-368150a7-95b9-424e-99d3-b93b533f2a86 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:10 devstack quobyte-client[84204]: System call of process 95292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:10 devstack quobyte-client[84204]: System call of process 95292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (3d61434f-b96a-4e0e-ac73-6e8a71083546) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:10 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=80, name=volume-368150a7-95b9-424e-99d3-b93b533f2a86, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b851fcaf-ca8c-445e-b9ba-2b4641c2d4b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:10 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Volume volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2 (db7a8b7a-a2bd-48be-ace5-e5772df42ff2): created successfully
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b851fcaf-ca8c-445e-b9ba-2b4641c2d4b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Flow 'volume_create_manager' (d103dd7f-749e-43b0-98fe-9e208ae18e06) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:10 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-16e97c3c-2b88-458e-b57a-1dfd50f7a657 tempest-GroupsTest-1619064466 None] Created volume successfully.
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-368150a7-95b9-424e-99d3-b93b533f2a86 1073741824" returned: 0 in 0.655s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-368150a7-95b9-424e-99d3-b93b533f2a86 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-368150a7-95b9-424e-99d3-b93b533f2a86" returned: 0 in 0.123s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] <== create_volume: return (833ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.852s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7753100f-5d2a-46e6-a105-0e450803878a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-368150a7-95b9-424e-99d3-b93b533f2a86', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339f01fd-db39-44e6-b604-211e72a363c8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:10 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Volume volume-368150a7-95b9-424e-99d3-b93b533f2a86 (368150a7-95b9-424e-99d3-b93b533f2a86): created successfully
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (339f01fd-db39-44e6-b604-211e72a363c8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Flow 'volume_create_manager' (efe8e33f-b31c-4650-8fdd-cdf2420e38c0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:10 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-40ab9b5e-fef9-4a4a-9032-0ae624c2c6c4 tempest-VolumesTransfersV355Test-305072258 None] Created volume successfully.
Sep 24 18:34:11 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Acquiring lock "cinder-quobyte-db7a8b7a-a2bd-48be-ace5-e5772df42ff2" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Lock "cinder-quobyte-db7a8b7a-a2bd-48be-ace5-e5772df42ff2" acquired by "delete_volume" :: waited 0.056s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:11 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f0b3457f-e5be-481c-933b-20414b9fb507]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:12 devstack quobyte-client[84204]: System call of process 95296 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2" returned: 0 in 0.571s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:34:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:12 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-28fe766e-f873-4c76-afeb-5a50d1b5a5f6 tempest-VolumesTransfersV355Test-808923982 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:12 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-28fe766e-f873-4c76-afeb-5a50d1b5a5f6 tempest-VolumesTransfersV355Test-808923982 None] Transfer volume completed successfully.
Sep 24 18:34:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-db7a8b7a-a2bd-48be-ace5-e5772df42ff2" returned: 0 in 0.493s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.635s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Lock "cinder-quobyte-db7a8b7a-a2bd-48be-ace5-e5772df42ff2" released by "delete_volume" :: held 1.357s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:13 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Created reservations ['17a50e87-1d54-4411-99c0-07a3b30b7b71'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:13 devstack cinder-volume[84177]: WARNING cinder.quota [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-695921015 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-695921015, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:34:13 devstack cinder-volume[84177]: WARNING cinder.quota [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-695921015 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-695921015, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:34:13 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Created reservations ['a5cbdf20-5254-482a-bfb7-aca7c7c5be89', '71b2993d-1b71-4f0a-a372-282f6c065f77', '93964d74-1978-4fb4-a50f-301b635d5b95', '858fc477-10fb-4632-bb62-267ecb8ed85a'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.108s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:14 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:14 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-5d273b2e-f2a7-47f4-b463-9309a3587dc1 tempest-GroupsTest-1619064466 None] Delete group completed successfully.
Sep 24 18:34:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Acquiring lock "cinder-368150a7-95b9-424e-99d3-b93b533f2a86-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Lock "cinder-368150a7-95b9-424e-99d3-b93b533f2a86-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:14 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Acquiring lock "cinder-quobyte-368150a7-95b9-424e-99d3-b93b533f2a86" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Lock "cinder-quobyte-368150a7-95b9-424e-99d3-b93b533f2a86" acquired by "delete_volume" :: waited 0.011s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:14 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e21d6fcf-204d-435a-a001-0bbf6d2a493b]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-368150a7-95b9-424e-99d3-b93b533f2a86 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:15 devstack quobyte-client[84204]: System call of process 95302 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-368150a7-95b9-424e-99d3-b93b533f2a86" returned: 0 in 0.892s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-368150a7-95b9-424e-99d3-b93b533f2a86 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:15 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e10b9403-b3c9-4324-a4d8-c9902dea7789 tempest-GroupsTest-1619064466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-368150a7-95b9-424e-99d3-b93b533f2a86" returned: 0 in 0.363s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Lock "cinder-quobyte-368150a7-95b9-424e-99d3-b93b533f2a86" released by "delete_volume" :: held 1.448s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-e10b9403-b3c9-4324-a4d8-c9902dea7789 tempest-GroupsTest-1619064466 None] Created reservations ['433df9e6-2a79-4814-a65b-fb412d0deefe'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Created reservations ['b406743d-71bb-40ae-90c4-e54753d35c4a', '7620a30b-92a8-4cb8-82a4-fc4cd41d9ef2', '140be160-2776-427c-8a64-6bc53a6886ba', '6676c477-2550-4853-8d7a-1ce25c0a71e5'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e10b9403-b3c9-4324-a4d8-c9902dea7789 tempest-GroupsTest-1619064466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e10b9403-b3c9-4324-a4d8-c9902dea7789 tempest-GroupsTest-1619064466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e10b9403-b3c9-4324-a4d8-c9902dea7789 tempest-GroupsTest-1619064466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e10b9403-b3c9-4324-a4d8-c9902dea7789 tempest-GroupsTest-1619064466 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e10b9403-b3c9-4324-a4d8-c9902dea7789 tempest-GroupsTest-1619064466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e10b9403-b3c9-4324-a4d8-c9902dea7789 tempest-GroupsTest-1619064466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e10b9403-b3c9-4324-a4d8-c9902dea7789 tempest-GroupsTest-1619064466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.380s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-e10b9403-b3c9-4324-a4d8-c9902dea7789 tempest-GroupsTest-1619064466 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:16 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e10b9403-b3c9-4324-a4d8-c9902dea7789 tempest-GroupsTest-1619064466 None] Delete group completed successfully.
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:17 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.287s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:17 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:17 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Deleted volume successfully.
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-6acb8108-e599-40c0-a7dd-e00086d248fa tempest-VolumesTransfersV355Test-1099106934 None] Lock "cinder-368150a7-95b9-424e-99d3-b93b533f2a86-delete_volume" released by "delete_volume" :: held 4.168s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:18 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Flow 'volume_create_manager' (92fa6b3e-b0bc-4cf9-94d2-54ca280ee5bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18346f3-56f4-4ca8-9a78-45d503f5865a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:18 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e101c337-942b-4977-9eff-45a84746228a tempest-GroupsTest-1619064466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:18 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e101c337-942b-4977-9eff-45a84746228a tempest-GroupsTest-1619064466 None] Group tempest-GroupsTest-Group-220419360: creating
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a18346f3-56f4-4ca8-9a78-45d503f5865a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-162283869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2664190e-ac74-45e4-b122-bf92a30b7e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e516f0436a447798c0fde842a149a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:18Z,use_quota=True,user_id='bedf26b8d08a4b0ba73b91ecbfe988af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ea838b-03fa-40a4-9f4a-fda0a59937d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (35ea838b-03fa-40a4-9f4a-fda0a59937d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6a524f-c7a4-423e-acb9-f956ab62e013) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4a6a524f-c7a4-423e-acb9-f956ab62e013) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2664190e-ac74-45e4-b122-bf92a30b7e30', 'volume_name': 'volume-2664190e-ac74-45e4-b122-bf92a30b7e30', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6f07f0-6826-4b0b-9ed7-8dd78391a4c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8e6f07f0-6826-4b0b-9ed7-8dd78391a4c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcc9a54-c833-46db-91d1-abfa224fc2b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:18 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Volume 2664190e-ac74-45e4-b122-bf92a30b7e30: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2664190e-ac74-45e4-b122-bf92a30b7e30', 'volume_size': 1}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesTransfersV355Test-Volume-162283869',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2664190e-ac74-45e4-b122-bf92a30b7e30,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d1e516f0436a447798c0fde842a149a8',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:18Z,use_quota=True,user_id='bedf26b8d08a4b0ba73b91ecbfe988af',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Creating volume 2664190e-ac74-45e4-b122-bf92a30b7e30 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:18 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:34:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2664190e-ac74-45e4-b122-bf92a30b7e30 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:19 devstack quobyte-client[84204]: System call of process 95312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:19 devstack quobyte-client[84204]: System call of process 95312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:19 devstack quobyte-client[84204]: System call of process 95312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:19 devstack quobyte-client[84204]: System call of process 95312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:19 devstack quobyte-client[84204]: System call of process 95312 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:19 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=81, name=volume-2664190e-ac74-45e4-b122-bf92a30b7e30, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:34:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2664190e-ac74-45e4-b122-bf92a30b7e30 1073741824" returned: 0 in 0.747s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2664190e-ac74-45e4-b122-bf92a30b7e30 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:20 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e101c337-942b-4977-9eff-45a84746228a tempest-GroupsTest-1619064466 None] Group tempest-GroupsTest-Group-220419360: created successfully
Sep 24 18:34:20 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e101c337-942b-4977-9eff-45a84746228a tempest-GroupsTest-1619064466 None] Create group completed successfully.
Sep 24 18:34:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2664190e-ac74-45e4-b122-bf92a30b7e30" returned: 0 in 0.867s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] <== create_volume: return (1704ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:34:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.713s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9bcc9a54-c833-46db-91d1-abfa224fc2b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2664190e-ac74-45e4-b122-bf92a30b7e30', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3841a067-e440-463a-82e7-692f990b4d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:21 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Volume volume-2664190e-ac74-45e4-b122-bf92a30b7e30 (2664190e-ac74-45e4-b122-bf92a30b7e30): created successfully
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3841a067-e440-463a-82e7-692f990b4d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Flow 'volume_create_manager' (92fa6b3e-b0bc-4cf9-94d2-54ca280ee5bb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=127,cinder:DELETE=13,cinder:SELECT=88,cinder:INSERT=21 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:34:21 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-31126df0-5b1c-4310-b57b-8bf224705376 tempest-VolumesTransfersV355Test-305072258 None] Created volume successfully.
Sep 24 18:34:21 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Flow 'volume_create_manager' (62cd557d-999e-4cc2-b3ba-d9837312285a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6011a778-ed9c-4950-8250-d3195277a385) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=67,cinder:UPDATE=95,cinder:DELETE=7,cinder:INSERT=21 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6011a778-ed9c-4950-8250-d3195277a385) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-17446477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fe1f22e5-8508-44ff-8d5f-ffa75a467a88,host='devstack@QuobyteHD#QuobyteHD',id=a17e2032-18e7-4bcb-a5b1-2124aa9c690f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91156eb599c54c26a367704c2566a1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:21Z,use_quota=True,user_id='5789dda2b53c4f6b991958911ec916a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(874b298b-4e13-419a-a1b8-8c7dd127d461),volume_type_id=874b298b-4e13-419a-a1b8-8c7dd127d461)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d52f311-852e-4c14-858b-d43ce8179aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4d52f311-852e-4c14-858b-d43ce8179aae) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2adce6-571d-419c-b73b-80f993e3dc49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3e2adce6-571d-419c-b73b-80f993e3dc49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a17e2032-18e7-4bcb-a5b1-2124aa9c690f', 'volume_name': 'volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dba4722-d066-4ea8-b3c6-e6add4aa6193) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (7dba4722-d066-4ea8-b3c6-e6add4aa6193) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507d9bde-fb44-4233-963a-fb219a9e89f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:21 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Volume a17e2032-18e7-4bcb-a5b1-2124aa9c690f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f', 'volume_size': 1}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fe1f22e5-8508-44ff-8d5f-ffa75a467a88,created_at=2025-09-24T16:34:20Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-17446477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fe1f22e5-8508-44ff-8d5f-ffa75a467a88,host='devstack@QuobyteHD#QuobyteHD',id=a17e2032-18e7-4bcb-a5b1-2124aa9c690f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91156eb599c54c26a367704c2566a1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:21Z,use_quota=True,user_id='5789dda2b53c4f6b991958911ec916a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(874b298b-4e13-419a-a1b8-8c7dd127d461),volume_type_id=874b298b-4e13-419a-a1b8-8c7dd127d461)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Creating volume a17e2032-18e7-4bcb-a5b1-2124aa9c690f {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:21 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:34:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:21 devstack quobyte-client[84204]: System call of process 95329 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:22 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=82, name=volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Acquiring lock "cinder-2664190e-ac74-45e4-b122-bf92a30b7e30-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Lock "cinder-2664190e-ac74-45e4-b122-bf92a30b7e30-delete_volume" acquired by "delete_volume" :: waited 0.146s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f 1073741824" returned: 0 in 0.654s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f" returned: 0 in 0.327s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:22 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Acquiring lock "cinder-quobyte-2664190e-ac74-45e4-b122-bf92a30b7e30" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] <== create_volume: return (1139ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.149s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Lock "cinder-quobyte-2664190e-ac74-45e4-b122-bf92a30b7e30" acquired by "delete_volume" :: waited 0.106s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (507d9bde-fb44-4233-963a-fb219a9e89f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9266350c-e7df-4afa-922c-4d59df762843) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c0e73f77-89d8-440f-8297-597de7af6665]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2664190e-ac74-45e4-b122-bf92a30b7e30 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:23 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Volume volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f (a17e2032-18e7-4bcb-a5b1-2124aa9c690f): created successfully
Sep 24 18:34:23 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9266350c-e7df-4afa-922c-4d59df762843) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:23 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Flow 'volume_create_manager' (62cd557d-999e-4cc2-b3ba-d9837312285a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:23 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-79b9a946-7b4a-4199-bd9d-50605da3cd4e tempest-GroupsTest-1619064466 None] Created volume successfully.
Sep 24 18:34:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2664190e-ac74-45e4-b122-bf92a30b7e30" returned: 0 in 0.708s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2664190e-ac74-45e4-b122-bf92a30b7e30 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2664190e-ac74-45e4-b122-bf92a30b7e30" returned: 0 in 0.142s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Lock "cinder-quobyte-2664190e-ac74-45e4-b122-bf92a30b7e30" released by "delete_volume" :: held 1.091s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:24 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Flow 'volume_create_manager' (33df0e54-89c0-493d-ad7b-d6a27b22ee1a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04576059-ed1f-492e-a2a6-38ae8938a9e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (04576059-ed1f-492e-a2a6-38ae8938a9e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1345218979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fe1f22e5-8508-44ff-8d5f-ffa75a467a88,host='devstack@QuobyteHD#QuobyteHD',id=03cadfa5-a43d-42e2-9b5f-53dd3ac39a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91156eb599c54c26a367704c2566a1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:24Z,use_quota=True,user_id='5789dda2b53c4f6b991958911ec916a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(874b298b-4e13-419a-a1b8-8c7dd127d461),volume_type_id=874b298b-4e13-419a-a1b8-8c7dd127d461)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ed85ff-b12d-45fa-92c0-1c67cdea55ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90ed85ff-b12d-45fa-92c0-1c67cdea55ff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfba9ca-a7a9-445f-84d3-dbeb42be775a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7bfba9ca-a7a9-445f-84d3-dbeb42be775a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '03cadfa5-a43d-42e2-9b5f-53dd3ac39a20', 'volume_name': 'volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ad3de4-38c6-40b4-af23-9ffa1bc9477c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2ad3de4-38c6-40b4-af23-9ffa1bc9477c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ccfcd4-78fe-49f4-b1a7-770ec92aebdc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:24 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Volume 03cadfa5-a43d-42e2-9b5f-53dd3ac39a20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20', 'volume_size': 1}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=fe1f22e5-8508-44ff-8d5f-ffa75a467a88,created_at=2025-09-24T16:34:24Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-volume-1345218979',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=fe1f22e5-8508-44ff-8d5f-ffa75a467a88,host='devstack@QuobyteHD#QuobyteHD',id=03cadfa5-a43d-42e2-9b5f-53dd3ac39a20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='91156eb599c54c26a367704c2566a1c1',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:24Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:24Z,use_quota=True,user_id='5789dda2b53c4f6b991958911ec916a7',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(874b298b-4e13-419a-a1b8-8c7dd127d461),volume_type_id=874b298b-4e13-419a-a1b8-8c7dd127d461)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Creating volume 03cadfa5-a43d-42e2-9b5f-53dd3ac39a20 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:24 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:34:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:24 devstack quobyte-client[84204]: System call of process 95337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:24 devstack quobyte-client[84204]: System call of process 95337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:24 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=83, name=volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Created reservations ['eda923c2-31da-4144-9cd5-ff37390390fc', '2bea1822-73aa-4ee2-9a42-26f5de6ad0dc', '5f4c07be-db82-460e-8f8d-5e0cb0bdc701', 'aea59b10-e666-4409-9e45-11f980eafd53'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20 1073741824" returned: 0 in 0.487s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20" returned: 0 in 0.296s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] <== create_volume: return (821ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.831s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (99ccfcd4-78fe-49f4-b1a7-770ec92aebdc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b706dea2-af94-4fcc-85ec-9f9059990ba5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:25 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Volume volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20 (03cadfa5-a43d-42e2-9b5f-53dd3ac39a20): created successfully
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b706dea2-af94-4fcc-85ec-9f9059990ba5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Flow 'volume_create_manager' (33df0e54-89c0-493d-ad7b-d6a27b22ee1a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:25 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-43c4f7c1-59b0-4564-a929-590a0916dfed tempest-GroupsTest-1619064466 None] Created volume successfully.
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.151s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:26 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:26 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Deleted volume successfully.
Sep 24 18:34:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8cd4b3ac-5c9e-4193-8db4-c23afbed02ca tempest-VolumesTransfersV355Test-1099106934 None] Lock "cinder-2664190e-ac74-45e4-b122-bf92a30b7e30-delete_volume" released by "delete_volume" :: held 4.018s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:26 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-78cbbfc3-451b-4ecb-a28f-137a67072b74 tempest-GroupsTest-1619064466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:26 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-78cbbfc3-451b-4ecb-a28f-137a67072b74 tempest-GroupsTest-1619064466 None] Update group completed successfully.
Sep 24 18:34:28 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-86d4709d-8594-4ac8-a330-19984bee3074 tempest-GroupsTest-1619064466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:28 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-86d4709d-8594-4ac8-a330-19984bee3074 tempest-GroupsTest-1619064466 None] Update group completed successfully.
Sep 24 18:34:30 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Acquiring lock "cinder-quobyte-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Lock "cinder-quobyte-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20" acquired by "delete_volume" :: waited 0.130s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:31 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[373f8a96-7d49-4cf9-b641-20a917b1cd50]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:32 devstack quobyte-client[84204]: System call of process 95405 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:32 devstack quobyte-client[84204]: System call of process 95405 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:32 devstack quobyte-client[84204]: System call of process 95405 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20" returned: 0 in 1.213s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20" returned: 0 in 0.217s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:33 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Lock "cinder-quobyte-03cadfa5-a43d-42e2-9b5f-53dd3ac39a20" released by "delete_volume" :: held 2.010s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:33 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Acquiring lock "cinder-quobyte-a17e2032-18e7-4bcb-a5b1-2124aa9c690f" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:34:33 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Lock "cinder-quobyte-a17e2032-18e7-4bcb-a5b1-2124aa9c690f" acquired by "delete_volume" :: waited 0.060s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:34:33 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6c867189-4be8-4307-beb1-5fcd2d8be06f]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f" returned: 0 in 1.278s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a17e2032-18e7-4bcb-a5b1-2124aa9c690f" returned: 0 in 0.208s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Lock "cinder-quobyte-a17e2032-18e7-4bcb-a5b1-2124aa9c690f" released by "delete_volume" :: held 2.002s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:34:35 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Created reservations ['19a53e11-bad0-482d-9d91-77c8fdca1367'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:36 devstack cinder-volume[84177]: WARNING cinder.quota [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Deprecated: Default quota for resource: volumes_tempest-GroupsTest-volume-type-1440503753 is set by the default quota flag: quota_volumes_tempest-GroupsTest-volume-type-1440503753, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:34:36 devstack cinder-volume[84177]: WARNING cinder.quota [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Deprecated: Default quota for resource: gigabytes_tempest-GroupsTest-volume-type-1440503753 is set by the default quota flag: quota_gigabytes_tempest-GroupsTest-volume-type-1440503753, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:34:36 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Created reservations ['f2f5cadd-6760-4cd7-abf7-b4437c636eb4', 'dbf6b2ea-c1c2-448c-a461-8c422bf1c523', '4509ec7e-2e6a-4406-9944-00fe67cee293', '0f763964-21b8-4dec-ab03-124633646f60'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:36 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Created reservations ['17283931-d98e-455d-9a27-0e5ae7e60c1d', '684ec738-724a-49ad-a8f3-4113af227d2b', '42277331-d3c0-40ae-b039-a2846a66e1d5', '0654f0b6-4ed4-417d-8221-00c52012d3c1'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.041s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.167s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:37 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:37 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-424b08d1-cdc0-4c8d-994f-4b0b85622218 tempest-GroupsTest-1619064466 None] Delete group completed successfully.
Sep 24 18:34:43 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Flow 'volume_create_manager' (b8e46777-6f48-42b2-9cc0-069548dbcf92) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65150d80-1c73-4d26-bd15-240af9b1e7c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (65150d80-1c73-4d26-bd15-240af9b1e7c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1163722958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a9f70c-a501-493a-83da-21c44f57295d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e87110ba83348c3ae5af9774e143990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:43Z,use_quota=True,user_id='1de02616dcc24a23865ed53775d7434d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bedc924-0fbf-4016-8abb-832944f54bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0bedc924-0fbf-4016-8abb-832944f54bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402a21bb-be49-4cad-ab07-58a6725e33ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.image.glance [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Creating Keystone auth plugin from conf {{(pid=84177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (402a21bb-be49-4cad-ab07-58a6725e33ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '89a9f70c-a501-493a-83da-21c44f57295d', 'volume_name': 'volume-89a9f70c-a501-493a-83da-21c44f57295d', 'volume_size': 1, 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31cf1489d51f4b27a6681fc59f94a26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'created_at': datetime.datetime(2025, 9, 24, 16, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 1, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029a792a0>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8d2da1-3331-4011-9e18-3ff065c04ebf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0a8d2da1-3331-4011-9e18-3ff065c04ebf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907fc49b-57ad-4f0a-92e8-f4c08233a68a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:43 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Volume 89a9f70c-a501-493a-83da-21c44f57295d: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-89a9f70c-a501-493a-83da-21c44f57295d', 'volume_size': 1, 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31cf1489d51f4b27a6681fc59f94a26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'created_at': datetime.datetime(2025, 9, 24, 16, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 1, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029a792a0>}
Sep 24 18:34:43 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Cloning 89a9f70c-a501-493a-83da-21c44f57295d from image f48d314e-3a4b-4449-a990-1eaf5b733ce4  at location (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]). {{(pid=84177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 18:34:44 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ksb6dmkwdevstack@QuobyteHD, size 20.69 MB, duration 1.00 sec {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 18:34:44 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Image download 20.69 MB at 20.69 MB/s
Sep 24 18:34:44 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[43787f94-2884-4750-99a8-8c9fe4a01467]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ksb6dmkwdevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:45 devstack sudo[95471]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ksb6dmkwdevstack@QuobyteHD
Sep 24 18:34:45 devstack sudo[95471]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:34:47 devstack sudo[95471]: pam_unix(sudo:session): session closed for user root
Sep 24 18:34:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ksb6dmkwdevstack@QuobyteHD" returned: 0 in 2.775s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:47 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Temporary image f48d314e-3a4b-4449-a990-1eaf5b733ce4 is fetched for user 1de02616dcc24a23865ed53775d7434d. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 18:34:47 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b6331263-ba33-4954-bdfe-9bf5a69defe7]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ksb6dmkwdevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:48 devstack sudo[95478]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ksb6dmkwdevstack@QuobyteHD
Sep 24 18:34:48 devstack sudo[95478]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:34:51 devstack sudo[95478]: pam_unix(sudo:session): session closed for user root
Sep 24 18:34:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ksb6dmkwdevstack@QuobyteHD" returned: 0 in 3.764s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:34:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-1163722958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=89a9f70c-a501-493a-83da-21c44f57295d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e87110ba83348c3ae5af9774e143990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:34:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:34:43Z,use_quota=True,user_id='1de02616dcc24a23865ed53775d7434d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:34:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Creating volume 89a9f70c-a501-493a-83da-21c44f57295d {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:34:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:34:51 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:34:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:51 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-97d56bf6-d44d-4f90-9f8e-787eb472a521 tempest-GroupsV320Test-1405746246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:51 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-97d56bf6-d44d-4f90-9f8e-787eb472a521 tempest-GroupsV320Test-1405746246 None] Group tempest-GroupsV320Test-Group-1806322885: creating
Sep 24 18:34:52 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=84, name=volume-89a9f70c-a501-493a-83da-21c44f57295d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:34:52 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-97d56bf6-d44d-4f90-9f8e-787eb472a521 tempest-GroupsV320Test-1405746246 None] Group tempest-GroupsV320Test-Group-1806322885: created successfully
Sep 24 18:34:52 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-97d56bf6-d44d-4f90-9f8e-787eb472a521 tempest-GroupsV320Test-1405746246 None] Create group completed successfully.
Sep 24 18:34:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d 1073741824" returned: 0 in 0.589s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d" returned: 0 in 0.141s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] <== create_volume: return (802ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:34:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.833s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:52 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Attempting download of f48d314e-3a4b-4449-a990-1eaf5b733ce4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}])) to volume 89a9f70c-a501-493a-83da-21c44f57295d. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1184}}
Sep 24 18:34:52 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f555c41b-25d6-490f-8d3d-483ca25717a4]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ifjjh1qj {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ifjjh1qj" returned: 0 in 0.548s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ifjjh1qj {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ifjjh1qj" returned: 1 in 0.726s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ifjjh1qj' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:34:54 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4014bbcf-715f-4bb4-9bcd-a26da8e380b2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ksb6dmkwdevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:54 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a20c9929-6bf3-4cc6-be19-5fe073bfc41b tempest-GroupsV320Test-1405746246 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:34:54 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-a20c9929-6bf3-4cc6-be19-5fe073bfc41b tempest-GroupsV320Test-1405746246 None] Created reservations ['55f5c58c-c265-418b-815a-9c03d7dc16cd'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:34:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ksb6dmkwdevstack@QuobyteHD" returned: 0 in 0.656s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:55 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] f48d314e-3a4b-4449-a990-1eaf5b733ce4 was qcow2, converting to raw {{(pid=84177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 18:34:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ksb6dmkwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:55 devstack quobyte-client[84204]: System call of process 95532 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:55 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=84, name=volume-89a9f70c-a501-493a-83da-21c44f57295d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:34:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a20c9929-6bf3-4cc6-be19-5fe073bfc41b tempest-GroupsV320Test-1405746246 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:34:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a20c9929-6bf3-4cc6-be19-5fe073bfc41b tempest-GroupsV320Test-1405746246 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:34:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a20c9929-6bf3-4cc6-be19-5fe073bfc41b tempest-GroupsV320Test-1405746246 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:34:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a20c9929-6bf3-4cc6-be19-5fe073bfc41b tempest-GroupsV320Test-1405746246 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:34:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a20c9929-6bf3-4cc6-be19-5fe073bfc41b tempest-GroupsV320Test-1405746246 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:34:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a20c9929-6bf3-4cc6-be19-5fe073bfc41b tempest-GroupsV320Test-1405746246 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a20c9929-6bf3-4cc6-be19-5fe073bfc41b tempest-GroupsV320Test-1405746246 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.151s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:55 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-a20c9929-6bf3-4cc6-be19-5fe073bfc41b tempest-GroupsV320Test-1405746246 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:34:55 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a20c9929-6bf3-4cc6-be19-5fe073bfc41b tempest-GroupsV320Test-1405746246 None] Delete group completed successfully.
Sep 24 18:34:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ksb6dmkwdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d" returned: 0 in 1.678s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:56 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_ksb6dmkwdevstack@QuobyteHD, size 112.00 MB, duration 1.68 sec, destination /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:34:56 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Converted 112.00 MB image at 66.54 MB/s
Sep 24 18:34:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d 1G" returned: 0 in 0.327s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:57 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[5b3ef3d8-574e-46f2-ade2-12bb975e8e11]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:34:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d" returned: 0 in 0.518s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:34:58 devstack quobyte-client[84204]: System call of process 95545 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:34:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d" returned: 1 in 0.573s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:34:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:34:58 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Downloaded image f48d314e-3a4b-4449-a990-1eaf5b733ce4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}])) to volume 89a9f70c-a501-493a-83da-21c44f57295d successfully. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1229}}
Sep 24 18:34:58 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Temporary image f48d314e-3a4b-4449-a990-1eaf5b733ce4 for user 1de02616dcc24a23865ed53775d7434d is deleted. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 18:34:58 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Marking volume 89a9f70c-a501-493a-83da-21c44f57295d as bootable. {{(pid=84177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1133}}
Sep 24 18:34:58 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Copying metadata from image f48d314e-3a4b-4449-a990-1eaf5b733ce4 to 89a9f70c-a501-493a-83da-21c44f57295d. {{(pid=84177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 18:34:58 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Creating volume glance metadata for volume 89a9f70c-a501-493a-83da-21c44f57295d backed by image f48d314e-3a4b-4449-a990-1eaf5b733ce4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 18:34:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (907fc49b-57ad-4f0a-92e8-f4c08233a68a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-89a9f70c-a501-493a-83da-21c44f57295d', 'volume_size': 1, 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31cf1489d51f4b27a6681fc59f94a26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'created_at': datetime.datetime(2025, 9, 24, 16, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 1, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029a792a0>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a41ce3a-fd44-4443-be60-d1b5eac9e18b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:34:59 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Volume volume-89a9f70c-a501-493a-83da-21c44f57295d (89a9f70c-a501-493a-83da-21c44f57295d): created successfully
Sep 24 18:34:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1a41ce3a-fd44-4443-be60-d1b5eac9e18b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:34:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Flow 'volume_create_manager' (b8e46777-6f48-42b2-9cc0-069548dbcf92) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:34:59 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-9302f022-ae2a-4fd1-8a33-7304bfcc568f tempest-VolumesExtendTest-689363909 None] Created volume successfully.
Sep 24 18:35:00 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d7760964-4e7b-4533-a6c8-558a356efcbf tempest-VolumesExtendTest-689363909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d7760964-4e7b-4533-a6c8-558a356efcbf tempest-VolumesExtendTest-689363909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d7760964-4e7b-4533-a6c8-558a356efcbf tempest-VolumesExtendTest-689363909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:00 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[661b8a95-f375-4862-ace6-fb1e6004e365]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7760964-4e7b-4533-a6c8-558a356efcbf tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:01 devstack quobyte-client[84204]: System call of process 95550 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7760964-4e7b-4533-a6c8-558a356efcbf tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d" returned: 0 in 0.921s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7760964-4e7b-4533-a6c8-558a356efcbf tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Acquiring lock "cinder-97a7f009-0bb3-4814-bc60-3013ce83b30d-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Lock "cinder-97a7f009-0bb3-4814-bc60-3013ce83b30d-delete_volume" acquired by "delete_volume" :: waited 0.131s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:02 devstack quobyte-client[84204]: System call of process 95552 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:02 devstack quobyte-client[84204]: System call of process 95552 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:02 devstack quobyte-client[84204]: System call of process 95552 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:02 devstack quobyte-client[84204]: System call of process 95552 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7760964-4e7b-4533-a6c8-558a356efcbf tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d" returned: 1 in 0.846s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7760964-4e7b-4533-a6c8-558a356efcbf tempest-VolumesExtendTest-689363909 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:35:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7760964-4e7b-4533-a6c8-558a356efcbf tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d 2G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:02 devstack quobyte-client[84204]: System call of process 95555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:02 devstack quobyte-client[84204]: System call of process 95555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:02 devstack quobyte-client[84204]: System call of process 95555 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:02 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Acquiring lock "cinder-quobyte-97a7f009-0bb3-4814-bc60-3013ce83b30d" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d7760964-4e7b-4533-a6c8-558a356efcbf tempest-VolumesExtendTest-689363909 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d 2G" returned: 0 in 0.425s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d7760964-4e7b-4533-a6c8-558a356efcbf tempest-VolumesExtendTest-689363909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 2.362s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Lock "cinder-quobyte-97a7f009-0bb3-4814-bc60-3013ce83b30d" acquired by "delete_volume" :: waited 0.123s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:02 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b397517b-e2dd-4ebd-beb2-d3fdf3a02cb3]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-97a7f009-0bb3-4814-bc60-3013ce83b30d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:03 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d7760964-4e7b-4533-a6c8-558a356efcbf tempest-VolumesExtendTest-689363909 None] Extend volume completed successfully.
Sep 24 18:35:03 devstack quobyte-client[84204]: System call of process 95558 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:03 devstack quobyte-client[84204]: System call of process 95558 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:03 devstack quobyte-client[84204]: System call of process 95558 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-97a7f009-0bb3-4814-bc60-3013ce83b30d" returned: 0 in 0.623s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-97a7f009-0bb3-4814-bc60-3013ce83b30d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-97a7f009-0bb3-4814-bc60-3013ce83b30d" returned: 0 in 0.112s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Lock "cinder-quobyte-97a7f009-0bb3-4814-bc60-3013ce83b30d" released by "delete_volume" :: held 0.983s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:04 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Created reservations ['56c91ec0-4bcf-4826-aacb-0c776d0f1b60', '6ce669f9-dce0-4720-934f-c9f7c8496f53', '37c86a4a-7214-4ad1-b343-c0f51fd1e0a7', '6b5cef09-d05d-40ef-9e4b-1b65e645f4f6'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:35:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Acquiring lock "cinder-89a9f70c-a501-493a-83da-21c44f57295d-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Lock "cinder-89a9f70c-a501-493a-83da-21c44f57295d-delete_volume" acquired by "delete_volume" :: waited 0.099s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:04 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Acquiring lock "cinder-quobyte-89a9f70c-a501-493a-83da-21c44f57295d" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.289s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:04 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:35:04 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Deleted volume successfully.
Sep 24 18:35:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Lock "cinder-quobyte-89a9f70c-a501-493a-83da-21c44f57295d" acquired by "delete_volume" :: waited 0.236s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e64c0796-46dd-4345-a0f0-df75366cd597 tempest-VolumesNegativeTest-1564646578 None] Lock "cinder-97a7f009-0bb3-4814-bc60-3013ce83b30d-delete_volume" released by "delete_volume" :: held 3.050s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:05 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[413301bf-160a-4f99-aaf8-0503efe79c48]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d" returned: 0 in 0.538s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d" returned: 1 in 0.568s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:35:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-89a9f70c-a501-493a-83da-21c44f57295d" returned: 0 in 0.117s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Lock "cinder-quobyte-89a9f70c-a501-493a-83da-21c44f57295d" released by "delete_volume" :: held 1.621s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:06 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Created reservations ['46fb9170-b71b-4e4a-9ed5-f8490c0cb3bf', '2422038c-f5cd-4b3b-b7bb-7624dbb9b6d4', '04162c18-604b-49bf-ab94-5ef30673849b', '13331a1b-e616-47b9-8258-2c2f049d13f2'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:35:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:07 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:07 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.104s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:07 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:35:07 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Deleted volume successfully.
Sep 24 18:35:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-cdca9f5a-c86b-4640-894c-c411df2ff694 tempest-VolumesExtendTest-689363909 None] Lock "cinder-89a9f70c-a501-493a-83da-21c44f57295d-delete_volume" released by "delete_volume" :: held 3.221s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:08 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Flow 'volume_create_manager' (d4e2f2b3-9913-4d68-88b6-741710ae19ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df02e6dd-2512-4bf8-be05-6b379b8d75a7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (df02e6dd-2512-4bf8-be05-6b379b8d75a7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-837812505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b950431a-9627-4484-aca1-93d494372e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e87110ba83348c3ae5af9774e143990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:08Z,use_quota=True,user_id='1de02616dcc24a23865ed53775d7434d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae852d5-7b0e-45ee-9509-67c04d5987c6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (eae852d5-7b0e-45ee-9509-67c04d5987c6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d56a50f-4719-42a2-96f4-a441b809b00f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4d56a50f-4719-42a2-96f4-a441b809b00f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b950431a-9627-4484-aca1-93d494372e87', 'volume_name': 'volume-b950431a-9627-4484-aca1-93d494372e87', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d15a706-c608-4dbd-9146-f20ff7f061e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3d15a706-c608-4dbd-9146-f20ff7f061e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b31570-f9c4-4c88-ac90-0727b5625e34) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:08 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Volume b950431a-9627-4484-aca1-93d494372e87: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b950431a-9627-4484-aca1-93d494372e87', 'volume_size': 1}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesExtendTest-Volume-837812505',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b950431a-9627-4484-aca1-93d494372e87,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1e87110ba83348c3ae5af9774e143990',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:08Z,use_quota=True,user_id='1de02616dcc24a23865ed53775d7434d',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Creating volume b950431a-9627-4484-aca1-93d494372e87 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:35:08 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:35:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:08 devstack quobyte-client[84204]: System call of process 95576 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:09 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=85, name=volume-b950431a-9627-4484-aca1-93d494372e87, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:35:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87 1073741824" returned: 0 in 0.489s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87" returned: 0 in 0.095s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] <== create_volume: return (676ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:35:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.693s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (a1b31570-f9c4-4c88-ac90-0727b5625e34) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b950431a-9627-4484-aca1-93d494372e87', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3233ffc0-86af-4cbc-96f3-afc4efb7cdfa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:09 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Volume volume-b950431a-9627-4484-aca1-93d494372e87 (b950431a-9627-4484-aca1-93d494372e87): created successfully
Sep 24 18:35:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3233ffc0-86af-4cbc-96f3-afc4efb7cdfa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Flow 'volume_create_manager' (d4e2f2b3-9913-4d68-88b6-741710ae19ba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:09 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-581cd1a8-66a2-43e9-8bb4-f50bd9338f72 tempest-VolumesExtendTest-689363909 None] Created volume successfully.
Sep 24 18:35:11 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Creating offline snapshot e1ccf95b-adc5-49f1-a5f0-b5591292960e of volume b950431a-9627-4484-aca1-93d494372e87 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:35:11 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee98363a-6731-4e21-bc98-e02521b51c15]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:11 devstack quobyte-client[84204]: System call of process 95581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:11 devstack quobyte-client[84204]: System call of process 95581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:11 devstack quobyte-client[84204]: System call of process 95581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:11 devstack quobyte-client[84204]: System call of process 95581 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87" returned: 0 in 0.536s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:12 devstack quobyte-client[84204]: System call of process 95584 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:12 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=86, name=volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e 1G" returned: 0 in 0.598s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b950431a-9627-4484-aca1-93d494372e87 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.241s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:35:12 devstack quobyte-client[84204]: System call of process 95588 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:12 devstack quobyte-client[84204]: System call of process 95588 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] CMD "qemu-img rebase -u -b volume-b950431a-9627-4484-aca1-93d494372e87 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e" returned: 0 in 0.260s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:35:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e" returned: 0 in 0.121s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:35:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e" returned: 0 in 0.152s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.info" returned: 0 in 0.148s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:35:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.info" returned: 0 in 0.161s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.404s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:13 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-46c48552-4608-4d63-8036-570c91392328 tempest-VolumesExtendTest-689363909 None] Create snapshot completed successfully
Sep 24 18:35:14 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-600159e7-282f-482d-921b-0d15de607ef4 tempest-VolumesExtendTest-689363909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-600159e7-282f-482d-921b-0d15de607ef4 tempest-VolumesExtendTest-689363909 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-600159e7-282f-482d-921b-0d15de607ef4 tempest-VolumesExtendTest-689363909 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:14 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1e0f90f-7cf0-4e0b-95e1-28adf0833ad8]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-600159e7-282f-482d-921b-0d15de607ef4 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-600159e7-282f-482d-921b-0d15de607ef4 tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87" returned: 0 in 0.562s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-600159e7-282f-482d-921b-0d15de607ef4 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e 2G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:15 devstack quobyte-client[84204]: System call of process 95598 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:15 devstack quobyte-client[84204]: System call of process 95598 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:15 devstack quobyte-client[84204]: System call of process 95598 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:15 devstack quobyte-client[84204]: System call of process 95598 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-600159e7-282f-482d-921b-0d15de607ef4 tempest-VolumesExtendTest-689363909 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e 2G" returned: 0 in 0.331s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-600159e7-282f-482d-921b-0d15de607ef4 tempest-VolumesExtendTest-689363909 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.extend_volume" :: held 1.024s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:15 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-600159e7-282f-482d-921b-0d15de607ef4 tempest-VolumesExtendTest-689363909 None] Extend volume completed successfully.
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Acquiring lock "cinder-e1ccf95b-adc5-49f1-a5f0-b5591292960e-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Lock "cinder-e1ccf95b-adc5-49f1-a5f0-b5591292960e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:17 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Acquiring lock "cinder-quobyte-b950431a-9627-4484-aca1-93d494372e87" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Lock "cinder-quobyte-b950431a-9627-4484-aca1-93d494372e87" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Acquiring lock "cinder-quobyte-e1ccf95b-adc5-49f1-a5f0-b5591292960e" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Lock "cinder-quobyte-e1ccf95b-adc5-49f1-a5f0-b5591292960e" acquired by "_delete_snapshot" :: waited 0.009s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Deleting offline snapshot e1ccf95b-adc5-49f1-a5f0-b5591292960e of volume b950431a-9627-4484-aca1-93d494372e87 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] snapshot_file for this snap is: volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[96813d12-beb5-4559-86d1-97f765e11216]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e" returned: 0 in 0.525s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b950431a-9627-4484-aca1-93d494372e87(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[62907735-8f2c-4a61-9dc2-6e5fa3d83989]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87" returned: 0 in 0.570s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e" returned: 0 in 0.365s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87.e1ccf95b-adc5-49f1-a5f0-b5591292960e" returned: 0 in 0.105s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Lock "cinder-quobyte-e1ccf95b-adc5-49f1-a5f0-b5591292960e" released by "_delete_snapshot" :: held 1.987s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Lock "cinder-quobyte-b950431a-9627-4484-aca1-93d494372e87" released by "delete_snapshot" :: held 2.008s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:19 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Created reservations ['51c4200b-f94b-4957-b048-7582e66c32a4', '8a27a5e0-5465-4958-8b19-07bcd8c424d6', 'f9339fc6-29b0-492e-8666-7571235d8176', '9efea417-b60f-43a2-bb7a-094d46f76b05'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:35:19 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Delete snapshot completed successfully.
Sep 24 18:35:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8abfa77c-2985-4847-9409-939f926cd31c tempest-VolumesExtendTest-689363909 None] Lock "cinder-e1ccf95b-adc5-49f1-a5f0-b5591292960e-delete_snapshot" released by "delete_snapshot" :: held 2.728s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Acquiring lock "cinder-b950431a-9627-4484-aca1-93d494372e87-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Lock "cinder-b950431a-9627-4484-aca1-93d494372e87-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:20 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Acquiring lock "cinder-quobyte-b950431a-9627-4484-aca1-93d494372e87" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Lock "cinder-quobyte-b950431a-9627-4484-aca1-93d494372e87" acquired by "delete_volume" :: waited 0.018s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:20 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9f96088c-4fc6-4a6f-b216-4adfe042ab67]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:21 devstack quobyte-client[84204]: System call of process 95612 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87" returned: 0 in 0.655s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b950431a-9627-4484-aca1-93d494372e87" returned: 0 in 0.196s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Lock "cinder-quobyte-b950431a-9627-4484-aca1-93d494372e87" released by "delete_volume" :: held 1.229s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:22 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=69,cinder:UPDATE=70,cinder:DELETE=6,cinder:INSERT=25 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:35:22 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Created reservations ['9b3b9af6-588a-4532-9d61-a4781e17876d', '74ef4512-f9df-43c6-a64a-622f23416904', '00ea46bf-6beb-4f74-aac5-cc4dfafa4272', '230ba793-a099-437c-87f2-396128b10281'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:35:22 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=75,cinder:SELECT=57,cinder:INSERT=18,cinder:DELETE=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:35:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.148s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:22 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:35:23 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Deleted volume successfully.
Sep 24 18:35:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4b9ce787-70f3-4ad0-b31e-3a520d6fd547 tempest-VolumesExtendTest-689363909 None] Lock "cinder-b950431a-9627-4484-aca1-93d494372e87-delete_volume" released by "delete_volume" :: held 2.871s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:28 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Flow 'volume_create_manager' (93b3e0dc-ea56-48aa-ba59-8cab4873f9ff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5295fe4-8b15-4c64-a5ea-fed6cce3f886) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (d5295fe4-8b15-4c64-a5ea-fed6cce3f886) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1831996047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed8e5ab-9b65-46fb-b82c-5ede457715aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8870ba59586b4a4794dcf80527d66062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:28Z,use_quota=True,user_id='e89a755b95f4439b865f5902427b4fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c86bf8a-b104-497e-b3d8-8e89d22e4419) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c86bf8a-b104-497e-b3d8-8e89d22e4419) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e95a2a2-ba12-4487-b028-1d57b30354d0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7e95a2a2-ba12-4487-b028-1d57b30354d0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eed8e5ab-9b65-46fb-b82c-5ede457715aa', 'volume_name': 'volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4697cfc-2e77-417b-ad71-1221802a1603) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c4697cfc-2e77-417b-ad71-1221802a1603) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055f4d31-dec5-4c3a-9620-9037917c8e3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:28 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Volume eed8e5ab-9b65-46fb-b82c-5ede457715aa: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa', 'volume_size': 1}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:27Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1831996047',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eed8e5ab-9b65-46fb-b82c-5ede457715aa,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8870ba59586b4a4794dcf80527d66062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:28Z,use_quota=True,user_id='e89a755b95f4439b865f5902427b4fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Creating volume eed8e5ab-9b65-46fb-b82c-5ede457715aa {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:35:28 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:28 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=88, name=volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa 1073741824" returned: 0 in 0.451s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa" returned: 0 in 0.183s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] <== create_volume: return (724ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:35:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.737s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (055f4d31-dec5-4c3a-9620-9037917c8e3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09faca43-8b1b-4d5e-b31e-d6928fe2c732) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:29 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Volume volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa (eed8e5ab-9b65-46fb-b82c-5ede457715aa): created successfully
Sep 24 18:35:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09faca43-8b1b-4d5e-b31e-d6928fe2c732) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Flow 'volume_create_manager' (93b3e0dc-ea56-48aa-ba59-8cab4873f9ff) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:29 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a4bf3bac-6d8c-46dc-97fe-d83c32dd67b7 tempest-VolumesListTestJSON-1235854161 None] Created volume successfully.
Sep 24 18:35:30 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:30 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:35:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Flow 'volume_create_manager' (55432c12-3701-4955-8e8f-78c31cf48e03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4101b642-b828-4969-92db-cf069395525d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4101b642-b828-4969-92db-cf069395525d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-744599535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ddbdd4-1828-41fa-9549-357208b31764,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8870ba59586b4a4794dcf80527d66062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:31Z,use_quota=True,user_id='e89a755b95f4439b865f5902427b4fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b25709-f112-4efa-b258-81bf71a36b62) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f6b25709-f112-4efa-b258-81bf71a36b62) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a179c4ce-54e3-47b9-9e01-72dbfb10f1d9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a179c4ce-54e3-47b9-9e01-72dbfb10f1d9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '30ddbdd4-1828-41fa-9549-357208b31764', 'volume_name': 'volume-30ddbdd4-1828-41fa-9549-357208b31764', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f85bb1-f22f-4fca-8d35-1562d5db89b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91f85bb1-f22f-4fca-8d35-1562d5db89b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283f7127-747c-4085-8d3c-c567837e4f9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:31 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Volume 30ddbdd4-1828-41fa-9549-357208b31764: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-30ddbdd4-1828-41fa-9549-357208b31764', 'volume_size': 1}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-744599535',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=30ddbdd4-1828-41fa-9549-357208b31764,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8870ba59586b4a4794dcf80527d66062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:31Z,use_quota=True,user_id='e89a755b95f4439b865f5902427b4fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Creating volume 30ddbdd4-1828-41fa-9549-357208b31764 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:35:31 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-30ddbdd4-1828-41fa-9549-357208b31764 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:31 devstack quobyte-client[84204]: System call of process 95622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:31 devstack quobyte-client[84204]: System call of process 95622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:31 devstack quobyte-client[84204]: System call of process 95622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:31 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=89, name=volume-30ddbdd4-1828-41fa-9549-357208b31764, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-30ddbdd4-1828-41fa-9549-357208b31764 1073741824" returned: 0 in 0.494s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-30ddbdd4-1828-41fa-9549-357208b31764 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-30ddbdd4-1828-41fa-9549-357208b31764" returned: 0 in 0.132s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] <== create_volume: return (722ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:35:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.739s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (283f7127-747c-4085-8d3c-c567837e4f9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-30ddbdd4-1828-41fa-9549-357208b31764', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1134078-d51c-47a4-8aee-a2ec4b39525b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:32 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Volume volume-30ddbdd4-1828-41fa-9549-357208b31764 (30ddbdd4-1828-41fa-9549-357208b31764): created successfully
Sep 24 18:35:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d1134078-d51c-47a4-8aee-a2ec4b39525b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Flow 'volume_create_manager' (55432c12-3701-4955-8e8f-78c31cf48e03) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:32 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-98e48367-f4ec-4e7c-994f-bcef532f4d99 tempest-VolumesListTestJSON-1235854161 None] Created volume successfully.
Sep 24 18:35:33 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Flow 'volume_create_manager' (b0fa7423-ec05-4b65-96f8-ccda718ddb98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109e89c1-cd4c-4553-b818-fc6ffa042c0e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (109e89c1-cd4c-4553-b818-fc6ffa042c0e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1171717210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68c4d6b-d439-49e9-a02f-fa1ad56abea3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8870ba59586b4a4794dcf80527d66062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:34Z,use_quota=True,user_id='e89a755b95f4439b865f5902427b4fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e878b5-3c8f-436d-a892-91283f63b58c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (78e878b5-3c8f-436d-a892-91283f63b58c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a06926-2507-424e-8f09-6c839854113e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (79a06926-2507-424e-8f09-6c839854113e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e68c4d6b-d439-49e9-a02f-fa1ad56abea3', 'volume_name': 'volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdeb0e0-21c5-4dc7-872c-f3bb337db926) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (dfdeb0e0-21c5-4dc7-872c-f3bb337db926) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32f150a-5939-4347-92ca-1e4a28fa3a42) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:33 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Volume e68c4d6b-d439-49e9-a02f-fa1ad56abea3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3', 'volume_size': 1}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:33Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesListTestJSON-Volume-1171717210',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e68c4d6b-d439-49e9-a02f-fa1ad56abea3,launched_at=None,metadata={Type='work'},migration_status=None,multiattach=False,previous_status=None,project_id='8870ba59586b4a4794dcf80527d66062',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:34Z,use_quota=True,user_id='e89a755b95f4439b865f5902427b4fdf',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Creating volume e68c4d6b-d439-49e9-a02f-fa1ad56abea3 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:35:33 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:35:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:34 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=90, name=volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:35:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3 1073741824" returned: 0 in 0.450s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3" returned: 0 in 0.206s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] <== create_volume: return (753ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:35:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.765s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d32f150a-5939-4347-92ca-1e4a28fa3a42) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2e3186-07aa-42e1-8fe6-32e12418cb29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:34 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Volume volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3 (e68c4d6b-d439-49e9-a02f-fa1ad56abea3): created successfully
Sep 24 18:35:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ae2e3186-07aa-42e1-8fe6-32e12418cb29) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Flow 'volume_create_manager' (b0fa7423-ec05-4b65-96f8-ccda718ddb98) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:35 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-8df42cdc-32e5-4f51-bf8e-e19f01451aa2 tempest-VolumesListTestJSON-1235854161 None] Created volume successfully.
Sep 24 18:35:41 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "cinder-e68c4d6b-d439-49e9-a02f-fa1ad56abea3-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:41 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Lock "cinder-e68c4d6b-d439-49e9-a02f-fa1ad56abea3-delete_volume" acquired by "delete_volume" :: waited 0.087s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:41 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:41 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "cinder-quobyte-e68c4d6b-d439-49e9-a02f-fa1ad56abea3" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:41 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Lock "cinder-quobyte-e68c4d6b-d439-49e9-a02f-fa1ad56abea3" acquired by "delete_volume" :: waited 0.026s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:41 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[98b51d3f-d83a-42eb-8da3-d27179315851]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:42 devstack quobyte-client[84204]: System call of process 95633 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:42 devstack quobyte-client[84204]: System call of process 95633 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:42 devstack quobyte-client[84204]: System call of process 95633 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3" returned: 0 in 0.556s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e68c4d6b-d439-49e9-a02f-fa1ad56abea3" returned: 0 in 0.262s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Lock "cinder-quobyte-e68c4d6b-d439-49e9-a02f-fa1ad56abea3" released by "delete_volume" :: held 1.086s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:43 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Flow 'volume_create_manager' (29821d11-9a1e-4981-b62a-98825a688f68) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbe539c-a481-4a1a-9474-c0f41d5b833f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (bfbe539c-a481-4a1a-9474-c0f41d5b833f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1120097765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eece4abb-2fec-4363-9e87-801a8bfe3a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00fdc1047d30401d9dd935cea36ce53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:43Z,use_quota=True,user_id='f57e7b97396349ffb212eccefb30cc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7190c5c-4861-40b3-a911-c7d6c7072e0a),volume_type_id=c7190c5c-4861-40b3-a911-c7d6c7072e0a)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1098bc-a5a2-4012-8c0f-266f2e561bbe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d1098bc-a5a2-4012-8c0f-266f2e561bbe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6759a3-3b54-4dd2-b77b-289ef4d725dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5a6759a3-3b54-4dd2-b77b-289ef4d725dd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'eece4abb-2fec-4363-9e87-801a8bfe3a34', 'volume_name': 'volume-eece4abb-2fec-4363-9e87-801a8bfe3a34', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b940243f-35e4-4611-a214-b68e859198e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b940243f-35e4-4611-a214-b68e859198e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18212a0c-1b96-4c3d-9f00-b8ad2f60a445) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:43 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume eece4abb-2fec-4363-9e87-801a8bfe3a34: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-eece4abb-2fec-4363-9e87-801a8bfe3a34', 'volume_size': 1}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:42Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1120097765',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=eece4abb-2fec-4363-9e87-801a8bfe3a34,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00fdc1047d30401d9dd935cea36ce53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:43Z,use_quota=True,user_id='f57e7b97396349ffb212eccefb30cc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(c7190c5c-4861-40b3-a911-c7d6c7072e0a),volume_type_id=c7190c5c-4861-40b3-a911-c7d6c7072e0a)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Creating volume eece4abb-2fec-4363-9e87-801a8bfe3a34 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:35:43 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eece4abb-2fec-4363-9e87-801a8bfe3a34 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:43 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=91, name=volume-eece4abb-2fec-4363-9e87-801a8bfe3a34, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Created reservations ['b4c8a88c-9e05-40ae-bdbf-91c4d3a2bf26', 'ee631466-f6e1-448e-8aa2-49c499e9d1ae', 'ce84bef6-aa34-4c99-bceb-b39fb3224203', '0674eaf8-5567-4400-a8ec-3f7e0121bd12'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eece4abb-2fec-4363-9e87-801a8bfe3a34 1073741824" returned: 0 in 0.715s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eece4abb-2fec-4363-9e87-801a8bfe3a34 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:44 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Flow 'volume_create_manager' (f089987b-2c18-4d93-83c7-c282a61ec897) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1880588-ab15-4aa7-9392-1e415e7aff4b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eece4abb-2fec-4363-9e87-801a8bfe3a34" returned: 0 in 0.510s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] <== create_volume: return (1259ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.287s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (f1880588-ab15-4aa7-9392-1e415e7aff4b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1902998483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b02221-13de-4c0b-9ded-5592c32711fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00fdc1047d30401d9dd935cea36ce53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:44Z,use_quota=True,user_id='f57e7b97396349ffb212eccefb30cc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d8646a7-bdc0-4c9b-9559-effdba7d99d4),volume_type_id=4d8646a7-bdc0-4c9b-9559-effdba7d99d4)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e492db9-c4ad-4f44-a88d-fb5e66a4ae6a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0e492db9-c4ad-4f44-a88d-fb5e66a4ae6a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3573cef9-bccc-400c-916f-ec7414a1e2cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3573cef9-bccc-400c-916f-ec7414a1e2cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '78b02221-13de-4c0b-9ded-5592c32711fe', 'volume_name': 'volume-78b02221-13de-4c0b-9ded-5592c32711fe', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579c1507-c562-42e5-bb8c-1af80907be22) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (579c1507-c562-42e5-bb8c-1af80907be22) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7be088f-5dcb-4af4-920f-3f1622b1b6e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:44 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume 78b02221-13de-4c0b-9ded-5592c32711fe: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-78b02221-13de-4c0b-9ded-5592c32711fe', 'volume_size': 1}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1902998483',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=78b02221-13de-4c0b-9ded-5592c32711fe,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00fdc1047d30401d9dd935cea36ce53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:44Z,use_quota=True,user_id='f57e7b97396349ffb212eccefb30cc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(4d8646a7-bdc0-4c9b-9559-effdba7d99d4),volume_type_id=4d8646a7-bdc0-4c9b-9559-effdba7d99d4)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Creating volume 78b02221-13de-4c0b-9ded-5592c32711fe {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:35:44 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:35:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-78b02221-13de-4c0b-9ded-5592c32711fe 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:44 devstack quobyte-client[84204]: System call of process 95641 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:44 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=92, name=volume-78b02221-13de-4c0b-9ded-5592c32711fe, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:35:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (18212a0c-1b96-4c3d-9f00-b8ad2f60a445) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-eece4abb-2fec-4363-9e87-801a8bfe3a34', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863e0029-589e-4fd1-a397-b378aee00709) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-78b02221-13de-4c0b-9ded-5592c32711fe 1073741824" returned: 0 in 0.753s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-78b02221-13de-4c0b-9ded-5592c32711fe {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "cinder-30ddbdd4-1828-41fa-9549-357208b31764-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:45 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Flow 'volume_create_manager' (bcef10d9-95c2-42e9-85c5-6b2c10a64bb7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b557ff9c-e5c0-4176-9fc9-f9f800d5382d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:46 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume volume-eece4abb-2fec-4363-9e87-801a8bfe3a34 (eece4abb-2fec-4363-9e87-801a8bfe3a34): created successfully
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (863e0029-589e-4fd1-a397-b378aee00709) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Flow 'volume_create_manager' (29821d11-9a1e-4981-b62a-98825a688f68) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b557ff9c-e5c0-4176-9fc9-f9f800d5382d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1883443958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20a9d20-d224-4914-9091-346e374060d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00fdc1047d30401d9dd935cea36ce53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:45Z,use_quota=True,user_id='f57e7b97396349ffb212eccefb30cc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9b7d370-91e5-43ea-aadb-6e28eae28b62),volume_type_id=d9b7d370-91e5-43ea-aadb-6e28eae28b62)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ab4875-864a-4931-ac70-7b822423f7af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (98ab4875-864a-4931-ac70-7b822423f7af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27282f48-d8dd-4b6b-865c-4661aa270410) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.image.glance [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Creating Keystone auth plugin from conf {{(pid=84177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 18:35:46 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d2fb87f1-1e7f-407e-a28f-69c5d2f4b54a tempest-TestInstancesWithCinderVolumes-1528960685 None] Created volume successfully.
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-78b02221-13de-4c0b-9ded-5592c32711fe" returned: 0 in 1.085s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] <== create_volume: return (1867ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.887s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Lock "cinder-30ddbdd4-1828-41fa-9549-357208b31764-delete_volume" acquired by "delete_volume" :: waited 0.656s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e7be088f-5dcb-4af4-920f-3f1622b1b6e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-78b02221-13de-4c0b-9ded-5592c32711fe', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da276fe7-4bb9-4bc3-8ca0-60ac3bf1bd71) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:47 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume volume-78b02221-13de-4c0b-9ded-5592c32711fe (78b02221-13de-4c0b-9ded-5592c32711fe): created successfully
Sep 24 18:35:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (da276fe7-4bb9-4bc3-8ca0-60ac3bf1bd71) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Flow 'volume_create_manager' (f089987b-2c18-4d93-83c7-c282a61ec897) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:47 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-ed0aea36-58d7-4052-ac7e-15e2db47faa0 tempest-TestInstancesWithCinderVolumes-1528960685 None] Created volume successfully.
Sep 24 18:35:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.822s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:47 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:35:47 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Deleted volume successfully.
Sep 24 18:35:47 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:47 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "cinder-quobyte-30ddbdd4-1828-41fa-9549-357208b31764" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:47 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-890512de-c8b1-4ce4-bcd9-54e394f5fd25 tempest-VolumesListTestJSON-1235854161 None] Lock "cinder-e68c4d6b-d439-49e9-a02f-fa1ad56abea3-delete_volume" released by "delete_volume" :: held 6.445s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:47 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Lock "cinder-quobyte-30ddbdd4-1828-41fa-9549-357208b31764" acquired by "delete_volume" :: waited 0.070s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:47 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f1420f6-7f55-4ca7-9252-1ae1dda68e2b]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-30ddbdd4-1828-41fa-9549-357208b31764 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (27282f48-d8dd-4b6b-865c-4661aa270410) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'c20a9d20-d224-4914-9091-346e374060d9', 'volume_name': 'volume-c20a9d20-d224-4914-9091-346e374060d9', 'volume_size': 1, 'image_id': 'd0698596-9c55-4993-a391-a390f34c85c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0698596-9c55-4993-a391-a390f34c85c2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1852485700', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00fdc1047d30401d9dd935cea36ce53a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0698596-9c55-4993-a391-a390f34c85c2', 'created_at': datetime.datetime(2025, 9, 24, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0698596-9c55-4993-a391-a390f34c85c2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029afc4c0>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66a30d0-9420-4ea4-8bd9-b2a2ca7c4d4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b66a30d0-9420-4ea4-8bd9-b2a2ca7c4d4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92bdcf9f-d47c-498a-968a-bf28fe06949b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:48 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume c20a9d20-d224-4914-9091-346e374060d9: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-c20a9d20-d224-4914-9091-346e374060d9', 'volume_size': 1, 'image_id': 'd0698596-9c55-4993-a391-a390f34c85c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0698596-9c55-4993-a391-a390f34c85c2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1852485700', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00fdc1047d30401d9dd935cea36ce53a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0698596-9c55-4993-a391-a390f34c85c2', 'created_at': datetime.datetime(2025, 9, 24, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0698596-9c55-4993-a391-a390f34c85c2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029afc4c0>}
Sep 24 18:35:48 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Cloning c20a9d20-d224-4914-9091-346e374060d9 from image d0698596-9c55-4993-a391-a390f34c85c2  at location (None, [{'url': 'file:///opt/stack/data/glance/images/d0698596-9c55-4993-a391-a390f34c85c2', 'metadata': {}}]). {{(pid=84177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 18:35:48 devstack quobyte-client[84204]: System call of process 95647 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-30ddbdd4-1828-41fa-9549-357208b31764" returned: 0 in 0.975s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-30ddbdd4-1828-41fa-9549-357208b31764 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-30ddbdd4-1828-41fa-9549-357208b31764" returned: 0 in 0.225s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:49 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Lock "cinder-quobyte-30ddbdd4-1828-41fa-9549-357208b31764" released by "delete_volume" :: held 1.495s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:49 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Created reservations ['fe4ffb65-840a-41c4-ac5f-f81466a4aeef', '526493ab-d872-4ecb-a248-378bd7ad7003', '2a629cd5-bb64-401f-b386-e52c9342d460', 'c11135c7-8890-41dd-83e6-b5c3572cc29c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:35:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.370s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:35:50 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Deleted volume successfully.
Sep 24 18:35:50 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Flow 'volume_create_manager' (bac99b56-5553-40e8-9397-29a763e36719) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d6ee1d-0d02-4113-934d-fc2b4d3f08df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (08d6ee1d-0d02-4113-934d-fc2b4d3f08df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-184179907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542216ce-2f8c-48d6-926a-48ae67a84610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad1f2c8656489583e889b9f2bb17d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:50Z,use_quota=True,user_id='0b6748b0fe394f7ba7fabc89d29a78db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be93bc96-4ea8-4d85-be7f-857c24ec4cde) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (be93bc96-4ea8-4d85-be7f-857c24ec4cde) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64dbc33-8226-4e4a-98be-fa6336fb0399) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f64dbc33-8226-4e4a-98be-fa6336fb0399) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '542216ce-2f8c-48d6-926a-48ae67a84610', 'volume_name': 'volume-542216ce-2f8c-48d6-926a-48ae67a84610', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41525fd5-6a7a-4f82-bad5-a6fdf26435b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (41525fd5-6a7a-4f82-bad5-a6fdf26435b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6054eed-a813-4647-bf3e-1e59e57711fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:50 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Volume 542216ce-2f8c-48d6-926a-48ae67a84610: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-542216ce-2f8c-48d6-926a-48ae67a84610', 'volume_size': 1}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-AbsoluteLimitsTests-Volume-184179907',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=542216ce-2f8c-48d6-926a-48ae67a84610,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8cad1f2c8656489583e889b9f2bb17d6',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:50Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:50Z,use_quota=True,user_id='0b6748b0fe394f7ba7fabc89d29a78db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Creating volume 542216ce-2f8c-48d6-926a-48ae67a84610 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:35:50 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-542216ce-2f8c-48d6-926a-48ae67a84610 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:50 devstack quobyte-client[84204]: System call of process 95654 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:50 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "cinder-eed8e5ab-9b65-46fb-b82c-5ede457715aa-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:50 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=93, name=volume-542216ce-2f8c-48d6-926a-48ae67a84610, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:35:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Lock "cinder-eed8e5ab-9b65-46fb-b82c-5ede457715aa-delete_volume" acquired by "delete_volume" :: waited 0.247s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0739499c-d41d-4b44-88d8-bc4089da0a1e tempest-VolumesListTestJSON-1235854161 None] Lock "cinder-30ddbdd4-1828-41fa-9549-357208b31764-delete_volume" released by "delete_volume" :: held 4.573s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-542216ce-2f8c-48d6-926a-48ae67a84610 1073741824" returned: 0 in 0.528s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-542216ce-2f8c-48d6-926a-48ae67a84610 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:51 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "cinder-quobyte-eed8e5ab-9b65-46fb-b82c-5ede457715aa" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-542216ce-2f8c-48d6-926a-48ae67a84610" returned: 0 in 0.449s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] <== create_volume: return (1016ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:35:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.025s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Lock "cinder-quobyte-eed8e5ab-9b65-46fb-b82c-5ede457715aa" acquired by "delete_volume" :: waited 0.118s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:51 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f3a611bc-8cc2-48a6-b23f-60ec1fea5d5c]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f6054eed-a813-4647-bf3e-1e59e57711fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-542216ce-2f8c-48d6-926a-48ae67a84610', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09476407-b55e-49d7-8b72-f3ee2b10021a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:35:52 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Volume volume-542216ce-2f8c-48d6-926a-48ae67a84610 (542216ce-2f8c-48d6-926a-48ae67a84610): created successfully
Sep 24 18:35:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (09476407-b55e-49d7-8b72-f3ee2b10021a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:35:52 devstack quobyte-client[84204]: System call of process 95659 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Flow 'volume_create_manager' (bac99b56-5553-40e8-9397-29a763e36719) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:35:52 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-53f7a570-0afb-4c9c-820e-361936448f3d tempest-AbsoluteLimitsTests-2141596009 None] Created volume successfully.
Sep 24 18:35:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa" returned: 0 in 0.762s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eed8e5ab-9b65-46fb-b82c-5ede457715aa" returned: 0 in 0.163s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Lock "cinder-quobyte-eed8e5ab-9b65-46fb-b82c-5ede457715aa" released by "delete_volume" :: held 1.228s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:53 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Created reservations ['e747b045-8283-47bc-a641-9ff757e5e640', '75ac6666-1529-4030-bbb8-781dea3f1b03', '89c3c1be-b94c-4421-83b7-648116e2deea', 'd7de14df-a0f5-4025-b58c-65e278748d5b'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:35:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Acquiring lock "cinder-542216ce-2f8c-48d6-926a-48ae67a84610-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.339s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:53 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:35:54 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Lock "cinder-542216ce-2f8c-48d6-926a-48ae67a84610-delete_volume" acquired by "delete_volume" :: waited 0.170s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:54 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Deleted volume successfully.
Sep 24 18:35:54 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-8ec97a33-112e-44a4-969b-27fb130247f1 tempest-VolumesListTestJSON-1235854161 None] Lock "cinder-eed8e5ab-9b65-46fb-b82c-5ede457715aa-delete_volume" released by "delete_volume" :: held 3.136s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:54 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:35:54 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Acquiring lock "cinder-quobyte-542216ce-2f8c-48d6-926a-48ae67a84610" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:35:54 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Lock "cinder-quobyte-542216ce-2f8c-48d6-926a-48ae67a84610" acquired by "delete_volume" :: waited 0.017s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:35:54 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[695e27ab-930b-4b80-b94b-d8a8fd6c15b4]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-542216ce-2f8c-48d6-926a-48ae67a84610 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:54 devstack quobyte-client[84204]: System call of process 95696 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:35:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-542216ce-2f8c-48d6-926a-48ae67a84610" returned: 0 in 0.513s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-542216ce-2f8c-48d6-926a-48ae67a84610 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-542216ce-2f8c-48d6-926a-48ae67a84610" returned: 0 in 0.129s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Lock "cinder-quobyte-542216ce-2f8c-48d6-926a-48ae67a84610" released by "delete_volume" :: held 0.828s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:55 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Created reservations ['5cb2c5e9-f768-447b-aa32-ff0dd9d00603', '7638f9f3-326b-4839-95a8-6d524ea96f52', '47a7a35d-9b81-4f17-bbdc-8b0c3f2b04d3', 'ff0bc2a6-10f8-44a2-8b6a-28de568ccb27'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:35:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:35:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:35:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:35:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:35:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:35:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.141s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:35:55 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:35:55 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Deleted volume successfully.
Sep 24 18:35:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7b6664d7-9772-49e4-a617-dd01588f3294 tempest-AbsoluteLimitsTests-2141596009 None] Lock "cinder-542216ce-2f8c-48d6-926a-48ae67a84610-delete_volume" released by "delete_volume" :: held 2.071s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:35:57 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_d0698596-9c55-4993-a391-a390f34c85c2_4u97bcoedevstack@QuobyteHD, size 20.69 MB, duration 8.58 sec {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 18:35:57 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Image download 20.69 MB at 2.41 MB/s
Sep 24 18:35:57 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7fe7b63e-aeb1-45e9-90bc-163ee698d42c]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:35:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0698596-9c55-4993-a391-a390f34c85c2_4u97bcoedevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:35:57 devstack sudo[95701]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0698596-9c55-4993-a391-a390f34c85c2_4u97bcoedevstack@QuobyteHD
Sep 24 18:35:57 devstack sudo[95701]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:36:00 devstack sudo[95701]: pam_unix(sudo:session): session closed for user root
Sep 24 18:36:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0698596-9c55-4993-a391-a390f34c85c2_4u97bcoedevstack@QuobyteHD" returned: 0 in 2.815s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:00 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Temporary image d0698596-9c55-4993-a391-a390f34c85c2 is fetched for user f57e7b97396349ffb212eccefb30cc8a. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 18:36:00 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e00b78b5-a353-4610-aa02-e18f2e43986a]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0698596-9c55-4993-a391-a390f34c85c2_4u97bcoedevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:01 devstack sudo[95708]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0698596-9c55-4993-a391-a390f34c85c2_4u97bcoedevstack@QuobyteHD
Sep 24 18:36:01 devstack sudo[95708]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:36:02 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Flow 'volume_create_manager' (cd40f4ac-d231-49bd-9a43-4b8c81bde60f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547e4d63-4046-4204-bc5f-d629bb8b8613) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (547e4d63-4046-4204-bc5f-d629bb8b8613) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1153093130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b5736d-2095-4ac6-a131-6af147c2989c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a4f2d497c248158126d2783e651e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:36:02Z,use_quota=True,user_id='b4c34db703364d6bb141f94c0169db6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e0c0d4-ae6b-48f4-8562-78fdccebedbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d0e0c0d4-ae6b-48f4-8562-78fdccebedbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8780a2b4-8b9f-4eae-8273-ff2196060c57) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (8780a2b4-8b9f-4eae-8273-ff2196060c57) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '68b5736d-2095-4ac6-a131-6af147c2989c', 'volume_name': 'volume-68b5736d-2095-4ac6-a131-6af147c2989c', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48dffc09-b867-467a-aae4-0dda3a2bc57e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48dffc09-b867-467a-aae4-0dda3a2bc57e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03299368-2d20-415a-8a9d-c980efa2571a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:03 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Volume 68b5736d-2095-4ac6-a131-6af147c2989c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-68b5736d-2095-4ac6-a131-6af147c2989c', 'volume_size': 1}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:36:02Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1153093130',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=68b5736d-2095-4ac6-a131-6af147c2989c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a4f2d497c248158126d2783e651e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:36:02Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:36:02Z,use_quota=True,user_id='b4c34db703364d6bb141f94c0169db6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Creating volume 68b5736d-2095-4ac6-a131-6af147c2989c {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:36:03 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:03 devstack quobyte-client[84204]: System call of process 95713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:03 devstack quobyte-client[84204]: System call of process 95713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:03 devstack quobyte-client[84204]: System call of process 95713 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:03 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=94, name=volume-68b5736d-2095-4ac6-a131-6af147c2989c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:36:03 devstack sudo[95708]: pam_unix(sudo:session): session closed for user root
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0698596-9c55-4993-a391-a390f34c85c2_4u97bcoedevstack@QuobyteHD" returned: 0 in 3.186s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c 1073741824" returned: 0 in 0.562s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c" returned: 0 in 0.127s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] <== create_volume: return (760ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.777s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.436s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:35:44Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestInstancesWithCinderVolumes-volume-1883443958',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=c20a9d20-d224-4914-9091-346e374060d9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='00fdc1047d30401d9dd935cea36ce53a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:35:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:35:45Z,use_quota=True,user_id='f57e7b97396349ffb212eccefb30cc8a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(d9b7d370-91e5-43ea-aadb-6e28eae28b62),volume_type_id=d9b7d370-91e5-43ea-aadb-6e28eae28b62)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Creating volume c20a9d20-d224-4914-9091-346e374060d9 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.024s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:36:04 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:04 devstack quobyte-client[84204]: System call of process 95717 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:04 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=95, name=volume-c20a9d20-d224-4914-9091-346e374060d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (03299368-2d20-415a-8a9d-c980efa2571a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-68b5736d-2095-4ac6-a131-6af147c2989c', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45a452d-fe18-4e15-9242-44ca4fbcb7bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:04 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Volume volume-68b5736d-2095-4ac6-a131-6af147c2989c (68b5736d-2095-4ac6-a131-6af147c2989c): created successfully
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f45a452d-fe18-4e15-9242-44ca4fbcb7bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Flow 'volume_create_manager' (cd40f4ac-d231-49bd-9a43-4b8c81bde60f) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:36:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 1073741824" returned: 0 in 0.735s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-38975088-d850-4214-aca5-cca813efeec3 tempest-VolumesDeleteCascade-729936305 None] Created volume successfully.
Sep 24 18:36:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9" returned: 0 in 0.314s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] <== create_volume: return (1094ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:36:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.127s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:05 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Attempting download of d0698596-9c55-4993-a391-a390f34c85c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0698596-9c55-4993-a391-a390f34c85c2', 'metadata': {}}])) to volume c20a9d20-d224-4914-9091-346e374060d9. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1184}}
Sep 24 18:36:05 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[de8bf664-c3ab-43a6-955b-d2cb750ab986]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0698596-9c55-4993-a391-a390f34c85c2_kaoropsi {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_d0698596-9c55-4993-a391-a390f34c85c2_kaoropsi" returned: 0 in 0.896s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0698596-9c55-4993-a391-a390f34c85c2_kaoropsi {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:06 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:07 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Creating offline snapshot be543071-25ee-4023-919e-1d645ae44b7e of volume 68b5736d-2095-4ac6-a131-6af147c2989c {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:36:07 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbed2de3-3cb0-40a9-8b31-c5920aaeaed8]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0698596-9c55-4993-a391-a390f34c85c2_kaoropsi" returned: 1 in 0.794s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_d0698596-9c55-4993-a391-a390f34c85c2_kaoropsi' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:36:07 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2c95f9a7-2c76-4f7a-af61-8d287be89795]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0698596-9c55-4993-a391-a390f34c85c2_4u97bcoedevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:07 devstack quobyte-client[84204]: System call of process 95730 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c" returned: 0 in 0.629s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:08 devstack quobyte-client[84204]: System call of process 95735 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:08 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=96, name=volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:36:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_d0698596-9c55-4993-a391-a390f34c85c2_4u97bcoedevstack@QuobyteHD" returned: 0 in 0.725s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:08 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] d0698596-9c55-4993-a391-a390f34c85c2 was qcow2, converting to raw {{(pid=84177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 18:36:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0698596-9c55-4993-a391-a390f34c85c2_4u97bcoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e 1G" returned: 0 in 0.575s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68b5736d-2095-4ac6-a131-6af147c2989c -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:08 devstack quobyte-client[84204]: System call of process 95740 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:08 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=95, name=volume-c20a9d20-d224-4914-9091-346e374060d9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:36:08 devstack quobyte-client[84204]: System call of process 95742 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:08 devstack quobyte-client[84204]: System call of process 95742 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img rebase -u -b volume-68b5736d-2095-4ac6-a131-6af147c2989c -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e" returned: 0 in 0.245s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:36:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e" returned: 0 in 0.153s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:36:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e" returned: 0 in 0.150s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.info" returned: 0 in 0.144s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:36:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.info" returned: 0 in 0.228s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.889s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_d0698596-9c55-4993-a391-a390f34c85c2_4u97bcoedevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9" returned: 0 in 1.662s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:09 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_d0698596-9c55-4993-a391-a390f34c85c2_4u97bcoedevstack@QuobyteHD, size 112.00 MB, duration 1.67 sec, destination /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:36:09 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Converted 112.00 MB image at 67.11 MB/s
Sep 24 18:36:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:10 devstack quobyte-client[84204]: System call of process 95755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:10 devstack quobyte-client[84204]: System call of process 95755 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 1G" returned: 0 in 0.275s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:10 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-8afa7a82-ba4b-4872-97f9-d4b63be59da3 tempest-VolumesDeleteCascade-729936305 None] Create snapshot completed successfully
Sep 24 18:36:10 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b7409a48-799f-4a3a-9e1a-a3ddbadc213b]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:10 devstack quobyte-client[84204]: System call of process 95758 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:10 devstack quobyte-client[84204]: System call of process 95758 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:10 devstack quobyte-client[84204]: System call of process 95758 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9" returned: 0 in 0.902s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:11 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:11 devstack quobyte-client[84204]: System call of process 95760 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Creating offline snapshot ce566c5c-ade0-4c40-bf61-d84563f0fbb3 of volume 68b5736d-2095-4ac6-a131-6af147c2989c {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9" returned: 1 in 0.884s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Downloaded image d0698596-9c55-4993-a391-a390f34c85c2 ((None, [{'url': 'file:///opt/stack/data/glance/images/d0698596-9c55-4993-a391-a390f34c85c2', 'metadata': {}}])) to volume c20a9d20-d224-4914-9091-346e374060d9 successfully. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1229}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Temporary image d0698596-9c55-4993-a391-a390f34c85c2 for user f57e7b97396349ffb212eccefb30cc8a is deleted. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Marking volume c20a9d20-d224-4914-9091-346e374060d9 as bootable. {{(pid=84177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1133}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecc45bf7-cef4-4e08-a894-3ffb088bf90c]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.022s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Copying metadata from image d0698596-9c55-4993-a391-a390f34c85c2 to c20a9d20-d224-4914-9091-346e374060d9. {{(pid=84177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 18:36:12 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Creating volume glance metadata for volume c20a9d20-d224-4914-9091-346e374060d9 backed by image d0698596-9c55-4993-a391-a390f34c85c2 with: {'image_id': 'd0698596-9c55-4993-a391-a390f34c85c2', 'image_name': 'tempest-scenario-img--1852485700', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 18:36:12 devstack quobyte-client[84204]: System call of process 95763 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e" returned: 0 in 0.919s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68b5736d-2095-4ac6-a131-6af147c2989c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.699s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:13 devstack quobyte-client[84204]: System call of process 95767 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:36:13 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=98, name=volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (92bdcf9f-d47c-498a-968a-bf28fe06949b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-c20a9d20-d224-4914-9091-346e374060d9', 'volume_size': 1, 'image_id': 'd0698596-9c55-4993-a391-a390f34c85c2', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/d0698596-9c55-4993-a391-a390f34c85c2', 'metadata': {}}]), 'image_meta': {'name': 'tempest-scenario-img--1852485700', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'private', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '00fdc1047d30401d9dd935cea36ce53a', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'd0698596-9c55-4993-a391-a390f34c85c2', 'created_at': datetime.datetime(2025, 9, 24, 16, 35, 39, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 35, 41, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/d0698596-9c55-4993-a391-a390f34c85c2/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029afc4c0>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec66bb4-b81f-4c03-8448-6c444cb90f78) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 1G" returned: 0 in 0.407s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:13 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume volume-c20a9d20-d224-4914-9091-346e374060d9 (c20a9d20-d224-4914-9091-346e374060d9): created successfully
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (0ec66bb4-b81f-4c03-8448-6c444cb90f78) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Flow 'volume_create_manager' (bcef10d9-95c2-42e9-85c5-6b2c10a64bb7) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img rebase -u -b volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3" returned: 0 in 0.368s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:36:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:14 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-74042487-baa8-4f6a-b4d4-078757c786c3 tempest-TestInstancesWithCinderVolumes-1528960685 None] Created volume successfully.
Sep 24 18:36:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3" returned: 0 in 0.302s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:36:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3" returned: 0 in 0.217s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.642s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:14 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1a7336d8-764c-4846-b8cb-8e8d35d58c9d tempest-VolumesDeleteCascade-729936305 None] Create snapshot completed successfully
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-68b5736d-2095-4ac6-a131-6af147c2989c-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-68b5736d-2095-4ac6-a131-6af147c2989c-delete_volume" acquired by "delete_volume" :: waited 0.059s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:15 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Performing cascade delete. {{(pid=84177) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-be543071-25ee-4023-919e-1d645ae44b7e-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-be543071-25ee-4023-919e-1d645ae44b7e-delete_snapshot" acquired by "delete_snapshot" :: waited 0.019s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:15 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-quobyte-68b5736d-2095-4ac6-a131-6af147c2989c" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-68b5736d-2095-4ac6-a131-6af147c2989c" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-quobyte-be543071-25ee-4023-919e-1d645ae44b7e" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-be543071-25ee-4023-919e-1d645ae44b7e" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Deleting offline snapshot be543071-25ee-4023-919e-1d645ae44b7e of volume 68b5736d-2095-4ac6-a131-6af147c2989c {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] snapshot_file for this snap is: volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[78330d16-d34c-4399-8676-76dac374559f]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:16 devstack quobyte-client[84204]: System call of process 95775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:16 devstack quobyte-client[84204]: System call of process 95775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e" returned: 0 in 0.499s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68b5736d-2095-4ac6-a131-6af147c2989c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:36:16 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b400594e-2d6f-4b57-b2e8-9a2d40ad18ec]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c" returned: 0 in 0.651s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:17 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[dd47687f-d68b-40d5-88fc-f063b39c73f0]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:17 devstack quobyte-client[84204]: System call of process 95781 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3" returned: 0 in 0.508s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:17 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68b5736d-2095-4ac6-a131-6af147c2989c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:36:17 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[93c9ea03-7b90-47ae-9cd0-7f5cb5fe300b]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:18 devstack quobyte-client[84204]: System call of process 95784 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e" returned: 0 in 0.516s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68b5736d-2095-4ac6-a131-6af147c2989c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:36:18 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8553f97b-d7a3-4d31-809d-6a38920ee80a]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:19 devstack quobyte-client[84204]: System call of process 95787 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c" returned: 0 in 0.655s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:19 devstack quobyte-client[84204]: System call of process 95790 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e" returned: 0 in 0.245s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.be543071-25ee-4023-919e-1d645ae44b7e" returned: 0 in 0.099s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img rebase -u -b volume-68b5736d-2095-4ac6-a131-6af147c2989c /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 -F qcow2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:19 devstack quobyte-client[84204]: System call of process 95794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:19 devstack quobyte-client[84204]: System call of process 95794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:19 devstack quobyte-client[84204]: System call of process 95794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img rebase -u -b volume-68b5736d-2095-4ac6-a131-6af147c2989c /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 -F qcow2" returned: 0 in 0.157s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-be543071-25ee-4023-919e-1d645ae44b7e" released by "_delete_snapshot" :: held 4.284s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:36:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-68b5736d-2095-4ac6-a131-6af147c2989c" released by "delete_snapshot" :: held 4.308s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:36:20 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Created reservations ['8915d4b9-9ef3-4d56-ba44-e3a35a22d7fd', '31f6b67f-ccc3-4ce9-91a9-17cbd8bc566f', 'f7e80940-049c-49cb-8a6a-f511b98c6b68', '7616d36e-ce0c-449e-8375-a001f0773365'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:36:20 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Delete snapshot completed successfully.
Sep 24 18:36:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-be543071-25ee-4023-919e-1d645ae44b7e-delete_snapshot" released by "delete_snapshot" :: held 5.045s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:36:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-ce566c5c-ade0-4c40-bf61-d84563f0fbb3-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-ce566c5c-ade0-4c40-bf61-d84563f0fbb3-delete_snapshot" acquired by "delete_snapshot" :: waited 0.021s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:20 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-quobyte-68b5736d-2095-4ac6-a131-6af147c2989c" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-68b5736d-2095-4ac6-a131-6af147c2989c" acquired by "delete_snapshot" :: waited 0.018s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-quobyte-ce566c5c-ade0-4c40-bf61-d84563f0fbb3" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-ce566c5c-ade0-4c40-bf61-d84563f0fbb3" acquired by "_delete_snapshot" :: waited 0.014s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Deleting offline snapshot ce566c5c-ade0-4c40-bf61-d84563f0fbb3 of volume 68b5736d-2095-4ac6-a131-6af147c2989c {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:36:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] snapshot_file for this snap is: volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:36:20 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fb47d648-b245-4e2e-8729-dfa89d92e817]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:21 devstack quobyte-client[84204]: System call of process 95798 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3" returned: 0 in 0.553s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-68b5736d-2095-4ac6-a131-6af147c2989c(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:36:21 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[446b4c9e-fd10-489f-a2f8-36792381af1b]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:21 devstack quobyte-client[84204]: System call of process 95801 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c" returned: 0 in 0.572s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:22 devstack quobyte-client[84204]: System call of process 95804 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:22 devstack quobyte-client[84204]: System call of process 95804 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3" returned: 0 in 0.296s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c.ce566c5c-ade0-4c40-bf61-d84563f0fbb3" returned: 0 in 0.184s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-ce566c5c-ade0-4c40-bf61-d84563f0fbb3" released by "_delete_snapshot" :: held 1.997s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:36:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-68b5736d-2095-4ac6-a131-6af147c2989c" released by "delete_snapshot" :: held 2.029s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:36:23 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=48,cinder:UPDATE=66,cinder:DELETE=10,cinder:INSERT=16 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:36:23 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=44,cinder:UPDATE=58,cinder:DELETE=5,cinder:INSERT=13 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:36:23 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Created reservations ['1c1fca71-8e47-4c6b-88ee-ca22f47e3096', 'e437917e-a5c7-4377-83f0-7917f4610ec9', 'df230a3d-a669-4673-b8b1-a33112e3c186', '7d58441c-a962-4481-be77-a5f2b5ea96e7'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:36:23 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Delete snapshot completed successfully.
Sep 24 18:36:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-ce566c5c-ade0-4c40-bf61-d84563f0fbb3-delete_snapshot" released by "delete_snapshot" :: held 3.162s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:36:23 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Snapshots deleted, issuing volume delete {{(pid=84177) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 24 18:36:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-quobyte-68b5736d-2095-4ac6-a131-6af147c2989c" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-68b5736d-2095-4ac6-a131-6af147c2989c" acquired by "delete_volume" :: waited 0.038s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:23 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f669549c-6314-4413-a931-f34c180bdcee]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:24 devstack quobyte-client[84204]: System call of process 95815 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c" returned: 0 in 0.919s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-68b5736d-2095-4ac6-a131-6af147c2989c" returned: 0 in 0.459s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-072a266f-05eb-4822-b201-a405b4c67d5c req-43ea69c4-7673-438f-8c7c-fcfb8c2f9463 tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-072a266f-05eb-4822-b201-a405b4c67d5c req-43ea69c4-7673-438f-8c7c-fcfb8c2f9463 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-68b5736d-2095-4ac6-a131-6af147c2989c" released by "delete_volume" :: held 1.619s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:36:25 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[30f65e6c-c1ff-4ce6-a1f8-96d90484e066]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-072a266f-05eb-4822-b201-a405b4c67d5c req-43ea69c4-7673-438f-8c7c-fcfb8c2f9463 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:26 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Created reservations ['4a339aac-78c1-4c11-bb4c-1dd643d0f874', '35b6e080-6566-4778-b3c4-1142072f93bd', '66f5741c-3e91-4c6a-9953-cf70010fd878', '4d6cc1dd-7eef-4d69-825a-b83ad2497b8d'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:36:26 devstack quobyte-client[84204]: System call of process 95821 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:26 devstack quobyte-client[84204]: System call of process 95821 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-072a266f-05eb-4822-b201-a405b4c67d5c req-43ea69c4-7673-438f-8c7c-fcfb8c2f9463 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9" returned: 0 in 0.996s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-072a266f-05eb-4822-b201-a405b4c67d5c req-43ea69c4-7673-438f-8c7c-fcfb8c2f9463 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:27 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:36:27 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:36:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.341s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:27 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:36:27 devstack quobyte-client[84204]: System call of process 95823 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:27 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Deleted volume successfully.
Sep 24 18:36:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-072a266f-05eb-4822-b201-a405b4c67d5c req-43ea69c4-7673-438f-8c7c-fcfb8c2f9463 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9" returned: 1 in 1.152s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-072a266f-05eb-4822-b201-a405b4c67d5c req-43ea69c4-7673-438f-8c7c-fcfb8c2f9463 tempest-TestInstancesWithCinderVolumes-1528960685 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:36:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-072a266f-05eb-4822-b201-a405b4c67d5c req-43ea69c4-7673-438f-8c7c-fcfb8c2f9463 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.374s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b7d88cb4-943f-44b1-a986-d444e6368869 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-68b5736d-2095-4ac6-a131-6af147c2989c-delete_volume" released by "delete_volume" :: held 12.554s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-072a266f-05eb-4822-b201-a405b4c67d5c req-43ea69c4-7673-438f-8c7c-fcfb8c2f9463 tempest-TestInstancesWithCinderVolumes-1528960685 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-c20a9d20-d224-4914-9091-346e374060d9', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '717fc5af-e345-4869-b109-eeaca3632c71', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:36:28 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-072a266f-05eb-4822-b201-a405b4c67d5c req-43ea69c4-7673-438f-8c7c-fcfb8c2f9463 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:28 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-072a266f-05eb-4822-b201-a405b4c67d5c req-43ea69c4-7673-438f-8c7c-fcfb8c2f9463 tempest-TestInstancesWithCinderVolumes-1528960685 None] attachment_update completed successfully.
Sep 24 18:36:28 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Flow 'volume_create_manager' (da26731a-9326-4d38-bbd7-473f5284cda0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b362a02c-98c7-47ab-b468-6759cefe0356) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b362a02c-98c7-47ab-b468-6759cefe0356) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-699332874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea8921d-1be6-432c-ad2c-a9cb87c5643d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a4f2d497c248158126d2783e651e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:36:29Z,use_quota=True,user_id='b4c34db703364d6bb141f94c0169db6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac49a550-daf0-4ab2-b912-2f3795b6a70a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac49a550-daf0-4ab2-b912-2f3795b6a70a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbf9ac9-b035-46a2-a911-3eb02a030902) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ffbf9ac9-b035-46a2-a911-3eb02a030902) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7ea8921d-1be6-432c-ad2c-a9cb87c5643d', 'volume_name': 'volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a261def8-1fe6-43fd-9312-60efee81b53c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (a261def8-1fe6-43fd-9312-60efee81b53c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a843930-d9ac-4411-9a97-93d5fe73dd6c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:28 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Volume 7ea8921d-1be6-432c-ad2c-a9cb87c5643d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d', 'volume_size': 1}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:36:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-699332874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7ea8921d-1be6-432c-ad2c-a9cb87c5643d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a4f2d497c248158126d2783e651e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:36:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:36:29Z,use_quota=True,user_id='b4c34db703364d6bb141f94c0169db6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Creating volume 7ea8921d-1be6-432c-ad2c-a9cb87c5643d {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:36:28 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:36:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:28 devstack quobyte-client[84204]: System call of process 95827 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:28 devstack quobyte-client[84204]: System call of process 95827 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:28 devstack quobyte-client[84204]: System call of process 95827 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:29 devstack quobyte-client[84204]: System call of process 95827 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:29 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=99, name=volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:36:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d 1073741824" returned: 0 in 0.432s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" returned: 0 in 0.132s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] <== create_volume: return (675ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:36:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.689s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0a843930-d9ac-4411-9a97-93d5fe73dd6c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4461abe8-9902-4044-8469-30fe46314983) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:29 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Volume volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d (7ea8921d-1be6-432c-ad2c-a9cb87c5643d): created successfully
Sep 24 18:36:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4461abe8-9902-4044-8469-30fe46314983) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Flow 'volume_create_manager' (da26731a-9326-4d38-bbd7-473f5284cda0) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:36:29 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a8648b59-497d-4c61-81b5-1691f05a7d82 tempest-VolumesDeleteCascade-729936305 None] Created volume successfully.
Sep 24 18:36:30 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Creating offline snapshot 0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 of volume 7ea8921d-1be6-432c-ad2c-a9cb87c5643d {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:36:31 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[30ab2d2f-5d4d-424b-878c-937b2c8a4668]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:31 devstack quobyte-client[84204]: System call of process 95833 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" returned: 0 in 0.661s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:31 devstack quobyte-client[84204]: System call of process 95901 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:32 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=100, name=volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 1G" returned: 0 in 0.353s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img rebase -u -b volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:32 devstack quobyte-client[84204]: System call of process 95905 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img rebase -u -b volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75" returned: 0 in 0.174s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75" returned: 0 in 0.115s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75" returned: 0 in 0.101s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.info" returned: 0 in 0.115s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:36:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.info" returned: 0 in 0.177s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.215s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:33 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-9a262523-1f31-4f1e-9d4c-2b11ee0fe64a tempest-VolumesDeleteCascade-729936305 None] Create snapshot completed successfully
Sep 24 18:36:34 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:34 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:36:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Flow 'volume_create_manager' (5a612a2a-b580-4efb-9ffb-5940dc52bc69) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:36:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4885d4-882a-4dc5-bba3-425b7410efea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:34 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:34 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:36:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Flow 'volume_create_manager' (0d8907be-34a2-4aa2-82b5-6f1040b7d1cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:36:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241ea029-b8c0-4613-862c-720d45149338) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5e4885d4-882a-4dc5-bba3-425b7410efea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesDeleteCascade-Volume-1807092360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6ccc37d8-af95-4f2e-8721-4f26b5ba81ac,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='47a4f2d497c248158126d2783e651e8d',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=0e1a29a4-5c16-4304-abb8-ec0be4c8bf75,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:36:35Z,use_quota=True,user_id='b4c34db703364d6bb141f94c0169db6f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5c86bb-eb36-416a-bdab-6a634a046dd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7a5c86bb-eb36-416a-bdab-6a634a046dd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2d0dca-420d-4e0c-9ce7-fb6bc381098d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (fd2d0dca-420d-4e0c-9ce7-fb6bc381098d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '6ccc37d8-af95-4f2e-8721-4f26b5ba81ac', 'volume_name': 'volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac', 'volume_size': 1, 'snapshot_id': '0e1a29a4-5c16-4304-abb8-ec0be4c8bf75'}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d1115d-550b-4e50-a883-4e29c83d37da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (83d1115d-550b-4e50-a883-4e29c83d37da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef91d5c-f78a-490f-9fe1-dd04acc17417) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:35 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Volume 6ccc37d8-af95-4f2e-8721-4f26b5ba81ac: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac', 'volume_size': 1, 'snapshot_id': '0e1a29a4-5c16-4304-abb8-ec0be4c8bf75'}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-quobyte-0e1a29a4-5c16-4304-abb8-ec0be4c8bf75-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" by "_create_volume_from_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (241ea029-b8c0-4613-862c-720d45149338) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1129991933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0f5e2b-c1e8-4c52-8774-f723bd24af88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1e75ec341a4d139e1a81eb1d6aeed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:36:35Z,use_quota=True,user_id='63b9907b6b6145779d637badcc7c7e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac760e54-eb60-4af8-9609-446fde50ca9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ac760e54-eb60-4af8-9609-446fde50ca9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e26048-5bfe-4d54-8faf-23e4333abe72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.image.glance [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Creating Keystone auth plugin from conf {{(pid=84177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-0e1a29a4-5c16-4304-abb8-ec0be4c8bf75-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" acquired by "_create_volume_from_snapshot" :: waited 0.081s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Creating volume 6ccc37d8-af95-4f2e-8721-4f26b5ba81ac from snapshot 0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 {{(pid=84177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-quobyte-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" by "_copy_volume_from_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" acquired by "_copy_volume_from_snapshot" :: waited 0.013s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] snapshot: 0e1a29a4-5c16-4304-abb8-ec0be4c8bf75, volume: 6ccc37d8-af95-4f2e-8721-4f26b5ba81ac,  {{(pid=84177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4b311a6f-6711-4df6-b868-710b6862e45c]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:35 devstack quobyte-client[84204]: System call of process 96235 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (11e26048-5bfe-4d54-8faf-23e4333abe72) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': 'aa0f5e2b-c1e8-4c52-8774-f723bd24af88', 'volume_name': 'volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88', 'volume_size': 1, 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31cf1489d51f4b27a6681fc59f94a26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'created_at': datetime.datetime(2025, 9, 24, 16, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 1, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f303119ea70>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2516163e-ad27-4c47-88e4-b91019e2c5f0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2516163e-ad27-4c47-88e4-b91019e2c5f0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:36 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2121c9-d012-4c96-b47e-128674e02e75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:36 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Volume aa0f5e2b-c1e8-4c52-8774-f723bd24af88: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88', 'volume_size': 1, 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31cf1489d51f4b27a6681fc59f94a26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'created_at': datetime.datetime(2025, 9, 24, 16, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 1, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f303119ea70>}
Sep 24 18:36:36 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Cloning aa0f5e2b-c1e8-4c52-8774-f723bd24af88 from image f48d314e-3a4b-4449-a990-1eaf5b733ce4  at location (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]). {{(pid=84177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 18:36:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75" returned: 0 in 0.766s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:36:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d {{(pid=84177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 24 18:36:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Creating direct copy from snapshot {{(pid=84177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 24 18:36:36 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[56022502-9128-4083-bd3b-349eb314c542]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:36 devstack quobyte-client[84204]: System call of process 96241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:36 devstack quobyte-client[84204]: System call of process 96241 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:37 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_bppv0dm1devstack@QuobyteHD, size 20.69 MB, duration 1.01 sec {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 18:36:37 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Image download 20.69 MB at 20.51 MB/s
Sep 24 18:36:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" returned: 0 in 1.075s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:37 devstack cinder-volume[84177]: DEBUG cinder.utils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac not found in is_blk_device check {{(pid=84177) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 24 18:36:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:37 devstack quobyte-client[84204]: System call of process 96250 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:37 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b3a421fe-a512-411d-b9b2-50e5edb6c8aa]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_bppv0dm1devstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:37 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=102, name=volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:36:39 devstack sudo[96255]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_bppv0dm1devstack@QuobyteHD
Sep 24 18:36:39 devstack sudo[96255]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:36:45 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=12,cinder:INSERT=4,cinder:UPDATE=19,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:36:45 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=25,cinder:INSERT=4,cinder:UPDATE=18,cinder:DELETE=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:36:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" returned: 0 in 10.066s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:47 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[267d188c-2835-4b69-9c70-af84ec9758a2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:48 devstack quobyte-client[84204]: System call of process 96317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:48 devstack quobyte-client[84204]: System call of process 96317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:48 devstack quobyte-client[84204]: System call of process 96317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:48 devstack quobyte-client[84204]: System call of process 96317 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" returned: 0 in 1.844s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:49 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d, size 1024.00 MB, duration 10.07 sec, destination /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:36:49 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Converted 1024.00 MB image at 101.65 MB/s
Sep 24 18:36:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:36:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" returned: 0 in 0.372s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:50 devstack sudo[96255]: pam_unix(sudo:session): session closed for user root
Sep 24 18:36:50 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" released by "_copy_volume_from_snapshot" :: held 15.043s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:36:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_bppv0dm1devstack@QuobyteHD" returned: 0 in 12.629s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:50 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Temporary image f48d314e-3a4b-4449-a990-1eaf5b733ce4 is fetched for user 63b9907b6b6145779d637badcc7c7e4e. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 18:36:50 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-0e1a29a4-5c16-4304-abb8-ec0be4c8bf75-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" released by "_create_volume_from_snapshot" :: held 15.212s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:36:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 15.305s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:36:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (cef91d5c-f78a-490f-9fe1-dd04acc17417) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac', 'volume_size': 1, 'snapshot_id': '0e1a29a4-5c16-4304-abb8-ec0be4c8bf75'}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc89ad08-b432-4748-8a59-8184cc692dd7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:36:51 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1ac37c6e-8011-484e-a00d-1f6c16eb2b90]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_bppv0dm1devstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:51 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Volume volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac (6ccc37d8-af95-4f2e-8721-4f26b5ba81ac): created successfully
Sep 24 18:36:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (fc89ad08-b432-4748-8a59-8184cc692dd7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:36:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Flow 'volume_create_manager' (5a612a2a-b580-4efb-9ffb-5940dc52bc69) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:36:52 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-7bf6a59c-d983-4046-ad54-b83a6342427c tempest-VolumesDeleteCascade-729936305 None] Created volume successfully.
Sep 24 18:36:52 devstack sudo[96336]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_bppv0dm1devstack@QuobyteHD
Sep 24 18:36:52 devstack sudo[96336]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:36:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-7ea8921d-1be6-432c-ad2c-a9cb87c5643d-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-7ea8921d-1be6-432c-ad2c-a9cb87c5643d-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:52 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Performing cascade delete. {{(pid=84177) delete_volume /opt/stack/cinder/cinder/volume/manager.py:995}}
Sep 24 18:36:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-0e1a29a4-5c16-4304-abb8-ec0be4c8bf75-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-0e1a29a4-5c16-4304-abb8-ec0be4c8bf75-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:36:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-quobyte-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" acquired by "delete_snapshot" :: waited 0.027s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-quobyte-0e1a29a4-5c16-4304-abb8-ec0be4c8bf75" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:36:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-0e1a29a4-5c16-4304-abb8-ec0be4c8bf75" acquired by "_delete_snapshot" :: waited 0.019s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:36:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Deleting offline snapshot 0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 of volume 7ea8921d-1be6-432c-ad2c-a9cb87c5643d {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:36:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] snapshot_file for this snap is: volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:36:53 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9de83fd8-19a5-419c-9c7a-8a1516472b08]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:55 devstack quobyte-client[84204]: System call of process 96364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:55 devstack quobyte-client[84204]: System call of process 96364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:55 devstack quobyte-client[84204]: System call of process 96364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:55 devstack quobyte-client[84204]: System call of process 96364 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75" returned: 0 in 2.625s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:36:56 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fa5b9aaa-1503-49fc-91e0-7929eef2b736]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:36:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:57 devstack quobyte-client[84204]: System call of process 96400 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" returned: 0 in 1.716s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:58 devstack quobyte-client[84204]: System call of process 96407 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:58 devstack quobyte-client[84204]: System call of process 96407 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:36:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75" returned: 0 in 0.803s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:36:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d.0e1a29a4-5c16-4304-abb8-ec0be4c8bf75" returned: 0 in 0.529s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:36:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-0e1a29a4-5c16-4304-abb8-ec0be4c8bf75" released by "_delete_snapshot" :: held 6.562s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:36:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" released by "delete_snapshot" :: held 6.636s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:37:00 devstack sudo[96336]: pam_unix(sudo:session): session closed for user root
Sep 24 18:37:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_bppv0dm1devstack@QuobyteHD" returned: 0 in 9.229s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:36:34Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-tempest.common.compute-volume-1129991933',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=aa0f5e2b-c1e8-4c52-8774-f723bd24af88,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8d1e75ec341a4d139e1a81eb1d6aeed3',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:36:35Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:36:35Z,use_quota=True,user_id='63b9907b6b6145779d637badcc7c7e4e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:37:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Creating volume aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:37:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:37:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:37:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:37:00 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:37:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:00 devstack quobyte-client[84204]: System call of process 96412 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:00 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=103, name=volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:37:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 1073741824" returned: 0 in 0.759s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:01 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Created reservations ['c77417d7-6f35-41e3-ba83-8881dca5391e', '56003d7e-e0f7-4485-95fe-a8c992b87013', '8658c034-a174-4081-aba8-5ec83297e1bb', '9c74779a-3273-4cad-9cd4-f3b99790a3d5'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:37:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" returned: 0 in 0.376s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] <== create_volume: return (1198ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:37:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.241s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:01 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Delete snapshot completed successfully.
Sep 24 18:37:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-0e1a29a4-5c16-4304-abb8-ec0be4c8bf75-delete_snapshot" released by "delete_snapshot" :: held 8.805s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:37:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Snapshots deleted, issuing volume delete {{(pid=84177) delete_volume /opt/stack/cinder/cinder/volume/manager.py:1010}}
Sep 24 18:37:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-quobyte-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:37:01 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Attempting download of f48d314e-3a4b-4449-a990-1eaf5b733ce4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}])) to volume aa0f5e2b-c1e8-4c52-8774-f723bd24af88. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1184}}
Sep 24 18:37:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" acquired by "delete_volume" :: waited 0.153s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:37:02 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e8af7100-bfa1-41e2-8795-0fdc4dd992c0]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:37:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:02 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c7f3703b-df10-405c-8851-cdd4479225da]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:37:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_va6i23fr {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" returned: 0 in 0.789s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" returned: 0 in 0.263s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_va6i23fr" returned: 0 in 0.882s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_va6i23fr {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-7ea8921d-1be6-432c-ad2c-a9cb87c5643d" released by "delete_volume" :: held 1.645s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:37:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_va6i23fr" returned: 1 in 0.871s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_f48d314e-3a4b-4449-a990-1eaf5b733ce4_va6i23fr' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:37:04 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b472ff8e-dbcd-45d5-a63f-884ee48f0fc5]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:37:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_bppv0dm1devstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:04 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Created reservations ['9c3b6622-f1e8-4334-8bfc-1a6e226cfca9', '0e3c49c7-7fde-43a7-8558-28122c2ce28d', '2d73a87a-f768-4696-bd86-e6effd676de9', '0cf79eaa-dfd8-46f4-819d-fb05054ccbb5'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:37:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:37:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:37:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.194s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:05 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:37:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Deleted volume successfully.
Sep 24 18:37:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:37:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_bppv0dm1devstack@QuobyteHD" returned: 0 in 1.904s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:06 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] f48d314e-3a4b-4449-a990-1eaf5b733ce4 was qcow2, converting to raw {{(pid=84177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 18:37:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_bppv0dm1devstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:06 devstack quobyte-client[84204]: System call of process 96435 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:06 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=103, name=volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:37:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac-delete_volume" acquired by "delete_volume" :: waited 0.359s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:37:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-4ca13310-c520-42c5-9836-bdd3d437ef00 tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-7ea8921d-1be6-432c-ad2c-a9cb87c5643d-delete_volume" released by "delete_volume" :: held 14.418s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:37:07 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:37:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "cinder-quobyte-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:37:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" acquired by "delete_volume" :: waited 0.068s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:37:07 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6251510f-5162-4e86-acd8-a4c4326e5b26]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:37:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] CMD "qemu-img convert -O raw -f qcow2 /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_bppv0dm1devstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" returned: 0 in 1.560s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:07 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_f48d314e-3a4b-4449-a990-1eaf5b733ce4_bppv0dm1devstack@QuobyteHD, size 112.00 MB, duration 1.62 sec, destination /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:37:07 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Converted 112.00 MB image at 69.26 MB/s
Sep 24 18:37:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 1G" returned: 0 in 0.547s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:08 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[afe3fcf3-a3f0-41a3-9dc9-3a225bfa0fdb]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:37:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:08 devstack quobyte-client[84204]: System call of process 96442 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" returned: 0 in 1.337s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" returned: 0 in 0.191s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-quobyte-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac" released by "delete_volume" :: held 1.973s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:37:09 devstack quobyte-client[84204]: System call of process 96447 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" returned: 0 in 1.222s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Created reservations ['e8e99fd2-c1e4-4bf6-8837-97880f175b3a', 'c8099559-294d-4baf-8357-23353a49423c', '2ac5dc36-2093-4d97-91bd-a9445544a948', '01a438d1-0d9a-4cc5-bb8e-64c5ffdd1a3e'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.052s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.122s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:37:10 devstack quobyte-client[84204]: System call of process 96452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:10 devstack quobyte-client[84204]: System call of process 96452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:10 devstack quobyte-client[84204]: System call of process 96452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:10 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Deleted volume successfully.
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" returned: 1 in 1.059s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Downloaded image f48d314e-3a4b-4449-a990-1eaf5b733ce4 ((None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}])) to volume aa0f5e2b-c1e8-4c52-8774-f723bd24af88 successfully. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1229}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Temporary image f48d314e-3a4b-4449-a990-1eaf5b733ce4 for user 63b9907b6b6145779d637badcc7c7e4e is deleted. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 18:37:10 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Marking volume aa0f5e2b-c1e8-4c52-8774-f723bd24af88 as bootable. {{(pid=84177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1133}}
Sep 24 18:37:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-03dfcd5f-daf9-4b1a-ba46-09c11e1f4f2f tempest-VolumesDeleteCascade-729936305 None] Lock "cinder-6ccc37d8-af95-4f2e-8721-4f26b5ba81ac-delete_volume" released by "delete_volume" :: held 4.703s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:37:11 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Copying metadata from image f48d314e-3a4b-4449-a990-1eaf5b733ce4 to aa0f5e2b-c1e8-4c52-8774-f723bd24af88. {{(pid=84177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 18:37:11 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Creating volume glance metadata for volume aa0f5e2b-c1e8-4c52-8774-f723bd24af88 backed by image f48d314e-3a4b-4449-a990-1eaf5b733ce4 with: {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': '', 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_name': 'cirros-0.6.3-x86_64-disk', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'container_format': 'bare', 'disk_format': 'qcow2', 'min_disk': 0, 'min_ram': 0, 'size': 21692416}. {{(pid=84177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 18:37:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (eb2121c9-d012-4c96-b47e-128674e02e75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88', 'volume_size': 1, 'image_id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'metadata': {}}]), 'image_meta': {'name': 'cirros-0.6.3-x86_64-disk', 'disk_format': 'qcow2', 'container_format': 'bare', 'visibility': 'public', 'size': 21692416, 'virtual_size': 117440512, 'status': 'active', 'checksum': '87617e24a5e30cb3b87fda8c0764838f', 'protected': False, 'min_ram': 0, 'min_disk': 0, 'owner': '31cf1489d51f4b27a6681fc59f94a26b', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '9a9bce0083a00939ec17c11febbfc767aa211aaa54f51e75c5a8b271a9b5637c77205a518b7a2007cb391d23cceb01e0e4e8d64832317151bc85b734b92a7be0', 'id': 'f48d314e-3a4b-4449-a990-1eaf5b733ce4', 'created_at': datetime.datetime(2025, 9, 24, 16, 1, 13, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 1, 15, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/f48d314e-3a4b-4449-a990-1eaf5b733ce4/file', 'properties': {'hw_rng_model': 'virtio', 'owner_specified.openstack.md5': '', 'owner_specified.openstack.object': 'images/cirros-0.6.3-x86_64-disk', 'owner_specified.openstack.sha256': ''}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f303119ea70>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e21efb-18ee-4da9-838d-70c32cdebde3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:11 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Volume volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 (aa0f5e2b-c1e8-4c52-8774-f723bd24af88): created successfully
Sep 24 18:37:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (f8e21efb-18ee-4da9-838d-70c32cdebde3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Flow 'volume_create_manager' (0d8907be-34a2-4aa2-82b5-6f1040b7d1cd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:37:11 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-54aa7f70-50e9-480c-acca-bfba9357d51e tempest-TestShelveInstance-82699032 None] Created volume successfully.
Sep 24 18:37:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:37:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:37:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:37:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.126s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:37:15 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:37:15 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Flow 'volume_create_manager' (363d8a5c-af29-46c8-b2f5-56455b84b151) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334e1af5-1a60-4e47-8db5-c2fd57f3f2f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (334e1af5-1a60-4e47-8db5-c2fd57f3f2f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-47402013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71e869b-e4b0-4c9f-ab51-75b79212e59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d216d57d257c4637ae3e7d908a22a6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:37:16Z,use_quota=True,user_id='66b9c1f725c846678b846f581499f728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90158e36-5c72-4bb6-87fc-687bed443e44) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (90158e36-5c72-4bb6-87fc-687bed443e44) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048aaa29-dce6-4845-8b19-8e6a1a15a4f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (048aaa29-dce6-4845-8b19-8e6a1a15a4f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd71e869b-e4b0-4c9f-ab51-75b79212e59d', 'volume_name': 'volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c565c8a2-fb34-4148-9cbc-75add36805e5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c565c8a2-fb34-4148-9cbc-75add36805e5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbca4e23-62e4-449b-a358-7ef9081e3616) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:16 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Volume d71e869b-e4b0-4c9f-ab51-75b79212e59d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d', 'volume_size': 1}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:37:15Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesMetadataTest-Volume-47402013',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d71e869b-e4b0-4c9f-ab51-75b79212e59d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='d216d57d257c4637ae3e7d908a22a6b2',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:37:16Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:37:16Z,use_quota=True,user_id='66b9c1f725c846678b846f581499f728',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Creating volume d71e869b-e4b0-4c9f-ab51-75b79212e59d {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:37:16 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:16 devstack quobyte-client[84204]: System call of process 96458 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:16 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=104, name=volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d 1073741824" returned: 0 in 0.411s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d" returned: 0 in 0.268s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] <== create_volume: return (789ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:37:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.807s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:17 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dbca4e23-62e4-449b-a358-7ef9081e3616) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:17 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6868672e-84e9-49fd-a57f-346bc97a9739) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:17 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Volume volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d (d71e869b-e4b0-4c9f-ab51-75b79212e59d): created successfully
Sep 24 18:37:17 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6868672e-84e9-49fd-a57f-346bc97a9739) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:17 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Flow 'volume_create_manager' (363d8a5c-af29-46c8-b2f5-56455b84b151) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:37:17 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-3ae1a51c-b96d-4983-af90-36c4cc16b1f2 tempest-VolumesMetadataTest-1749417801 None] Created volume successfully.
Sep 24 18:37:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Acquiring lock "cinder-d71e869b-e4b0-4c9f-ab51-75b79212e59d-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:37:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Lock "cinder-d71e869b-e4b0-4c9f-ab51-75b79212e59d-delete_volume" acquired by "delete_volume" :: waited 0.222s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:37:19 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:37:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Acquiring lock "cinder-quobyte-d71e869b-e4b0-4c9f-ab51-75b79212e59d" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:37:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Lock "cinder-quobyte-d71e869b-e4b0-4c9f-ab51-75b79212e59d" acquired by "delete_volume" :: waited 0.011s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:37:19 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[84cfb35e-a181-48f6-8fe2-42052ef6b2be]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:37:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d" returned: 0 in 0.635s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d71e869b-e4b0-4c9f-ab51-75b79212e59d" returned: 0 in 0.174s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Lock "cinder-quobyte-d71e869b-e4b0-4c9f-ab51-75b79212e59d" released by "delete_volume" :: held 1.174s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:37:21 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Created reservations ['e63f4306-4d26-4804-be1b-26e182b7d071', '6ba338cc-ce5c-4fc4-b5d1-6c71974a9a61', '2269f781-ef6a-4488-a918-0e27dcc7e6da', '3f18f046-2472-4420-94c8-87000b8e4e5c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:37:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:37:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:37:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.605s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:22 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:37:22 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Deleted volume successfully.
Sep 24 18:37:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-919bacd1-2ece-463f-adff-b986abacf977 tempest-VolumesMetadataTest-1749417801 None] Lock "cinder-d71e869b-e4b0-4c9f-ab51-75b79212e59d-delete_volume" released by "delete_volume" :: held 3.767s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:37:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-26482a2c-145e-4e0b-a58b-74126b53a181 req-4edde0bf-32eb-4f27-8d67-ae7832d17ad2 tempest-TestShelveInstance-82699032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-26482a2c-145e-4e0b-a58b-74126b53a181 req-4edde0bf-32eb-4f27-8d67-ae7832d17ad2 tempest-TestShelveInstance-82699032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:24 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ff5f0ea-595b-400f-ad9d-12b0b0b09ff2]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:37:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-26482a2c-145e-4e0b-a58b-74126b53a181 req-4edde0bf-32eb-4f27-8d67-ae7832d17ad2 tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-26482a2c-145e-4e0b-a58b-74126b53a181 req-4edde0bf-32eb-4f27-8d67-ae7832d17ad2 tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" returned: 0 in 0.900s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-26482a2c-145e-4e0b-a58b-74126b53a181 req-4edde0bf-32eb-4f27-8d67-ae7832d17ad2 tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:26 devstack quobyte-client[84204]: System call of process 96495 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:26 devstack quobyte-client[84204]: System call of process 96495 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:26 devstack quobyte-client[84204]: System call of process 96495 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:26 devstack quobyte-client[84204]: System call of process 96495 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-26482a2c-145e-4e0b-a58b-74126b53a181 req-4edde0bf-32eb-4f27-8d67-ae7832d17ad2 tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" returned: 1 in 0.990s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-26482a2c-145e-4e0b-a58b-74126b53a181 req-4edde0bf-32eb-4f27-8d67-ae7832d17ad2 tempest-TestShelveInstance-82699032 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:37:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-26482a2c-145e-4e0b-a58b-74126b53a181 req-4edde0bf-32eb-4f27-8d67-ae7832d17ad2 tempest-TestShelveInstance-82699032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 2.237s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:26 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-26482a2c-145e-4e0b-a58b-74126b53a181 req-4edde0bf-32eb-4f27-8d67-ae7832d17ad2 tempest-TestShelveInstance-82699032 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'c7e9f33a-309c-48d7-92a4-bfc91992b2b1', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:37:26 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-26482a2c-145e-4e0b-a58b-74126b53a181 req-4edde0bf-32eb-4f27-8d67-ae7832d17ad2 tempest-TestShelveInstance-82699032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:37:26 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-26482a2c-145e-4e0b-a58b-74126b53a181 req-4edde0bf-32eb-4f27-8d67-ae7832d17ad2 tempest-TestShelveInstance-82699032 None] attachment_update completed successfully.
Sep 24 18:37:28 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Flow 'volume_create_manager' (62e337e7-3752-4470-9840-574d9e40c737) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f796a58-56ef-40fd-b820-9495eec97500) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8f796a58-56ef-40fd-b820-9495eec97500) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-365449986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5379e5-f627-4a75-97b3-f584117210d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c5f3e7894649ff9cab4ccd4f115da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:37:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:37:28Z,use_quota=True,user_id='2eb86c5c2801450386fcbec9716c7259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8873d3-df25-41cb-a6ed-e3b37717e638) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0a8873d3-df25-41cb-a6ed-e3b37717e638) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0a1e5d-e5ba-45a6-88dd-9f1eed96eda8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2d0a1e5d-e5ba-45a6-88dd-9f1eed96eda8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '8d5379e5-f627-4a75-97b3-f584117210d2', 'volume_name': 'volume-8d5379e5-f627-4a75-97b3-f584117210d2', 'volume_size': 2}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b40f8a-5aff-4744-9b49-478208a9c790) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (74b40f8a-5aff-4744-9b49-478208a9c790) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d3f2b0-d00e-4018-acd5-d5d664024c75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:28 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Volume 8d5379e5-f627-4a75-97b3-f584117210d2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-8d5379e5-f627-4a75-97b3-f584117210d2', 'volume_size': 2}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:37:28Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesCloneNegativeTest-Volume-365449986',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=8d5379e5-f627-4a75-97b3-f584117210d2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='25c5f3e7894649ff9cab4ccd4f115da9',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:37:28Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:37:28Z,use_quota=True,user_id='2eb86c5c2801450386fcbec9716c7259',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Creating volume 8d5379e5-f627-4a75-97b3-f584117210d2 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:37:28 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:37:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8d5379e5-f627-4a75-97b3-f584117210d2 2147483648 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:28 devstack quobyte-client[84204]: System call of process 96498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:28 devstack quobyte-client[84204]: System call of process 96498 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:28 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=105, name=volume-8d5379e5-f627-4a75-97b3-f584117210d2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:37:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8d5379e5-f627-4a75-97b3-f584117210d2 2147483648" returned: 0 in 0.565s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8d5379e5-f627-4a75-97b3-f584117210d2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8d5379e5-f627-4a75-97b3-f584117210d2" returned: 0 in 0.170s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] <== create_volume: return (811ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:37:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.828s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (98d3f2b0-d00e-4018-acd5-d5d664024c75) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-8d5379e5-f627-4a75-97b3-f584117210d2', 'volume_size': 2}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bed29d-4195-4576-b6be-c981551b49cd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:29 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Volume volume-8d5379e5-f627-4a75-97b3-f584117210d2 (8d5379e5-f627-4a75-97b3-f584117210d2): created successfully
Sep 24 18:37:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c6bed29d-4195-4576-b6be-c981551b49cd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Flow 'volume_create_manager' (62e337e7-3752-4470-9840-574d9e40c737) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:37:29 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b0131eb1-0930-4340-a54f-4e53e9e97598 tempest-VolumesCloneNegativeTest-208613408 None] Created volume successfully.
Sep 24 18:37:30 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Acquiring lock "cinder-8d5379e5-f627-4a75-97b3-f584117210d2-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:37:30 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Lock "cinder-8d5379e5-f627-4a75-97b3-f584117210d2-delete_volume" acquired by "delete_volume" :: waited 0.062s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:37:30 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:37:30 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Acquiring lock "cinder-quobyte-8d5379e5-f627-4a75-97b3-f584117210d2" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:37:30 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Lock "cinder-quobyte-8d5379e5-f627-4a75-97b3-f584117210d2" acquired by "delete_volume" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:37:30 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[b8d84949-cab2-40f5-9708-85e0ebbe76f2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:37:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8d5379e5-f627-4a75-97b3-f584117210d2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8d5379e5-f627-4a75-97b3-f584117210d2" returned: 0 in 0.442s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8d5379e5-f627-4a75-97b3-f584117210d2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-8d5379e5-f627-4a75-97b3-f584117210d2" returned: 0 in 0.089s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Lock "cinder-quobyte-8d5379e5-f627-4a75-97b3-f584117210d2" released by "delete_volume" :: held 0.724s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Created reservations ['f592d169-f2a4-4194-a419-eb100fdc0ba0', 'dcbdbdfa-8bd0-40a4-b463-8fb03659ba28', '76b732fd-4559-4803-b74a-85dabc5bfa3f', 'a9618daf-43df-4105-a7fb-33bc21afe48b'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.079s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:31 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:37:32 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Deleted volume successfully.
Sep 24 18:37:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-aa5a5538-14b1-4fcf-a647-cc2cade7ade8 tempest-VolumesCloneNegativeTest-208613408 None] Lock "cinder-8d5379e5-f627-4a75-97b3-f584117210d2-delete_volume" released by "delete_volume" :: held 1.613s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:37:38 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:37:38 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:37:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Flow 'volume_create_manager' (f1e1cd38-ea8c-4bdb-9f90-e86301f55aae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:37:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ef10c6-b9b1-4492-898a-b3133fd88e3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a3ef10c6-b9b1-4492-898a-b3133fd88e3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1598454377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484b3d67-fc1d-4746-b176-cd09cf728cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cbd6a99cd6489dbd61eb7303da5538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:37:38Z,use_quota=True,user_id='266be88add2a4ef9bab9c07160d80639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d821844-f808-4628-872c-5bc5f8cc4ba2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3d821844-f808-4628-872c-5bc5f8cc4ba2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1a1734-edb4-4a63-8f46-6a3bb412a0de) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (aa1a1734-edb4-4a63-8f46-6a3bb412a0de) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '484b3d67-fc1d-4746-b176-cd09cf728cb1', 'volume_name': 'volume-484b3d67-fc1d-4746-b176-cd09cf728cb1', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:38 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88839fe-1421-41f4-836f-4a46a79dc045) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e88839fe-1421-41f4-836f-4a46a79dc045) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1556bd44-8a75-4ef4-a6c1-0fac9dcc5f2c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:39 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Volume 484b3d67-fc1d-4746-b176-cd09cf728cb1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-484b3d67-fc1d-4746-b176-cd09cf728cb1', 'volume_size': 1}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:37:38Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotListTestJSON-Volume-1598454377',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=484b3d67-fc1d-4746-b176-cd09cf728cb1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e2cbd6a99cd6489dbd61eb7303da5538',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:37:38Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:37:38Z,use_quota=True,user_id='266be88add2a4ef9bab9c07160d80639',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Creating volume 484b3d67-fc1d-4746-b176-cd09cf728cb1 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.029s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:37:39 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:39 devstack quobyte-client[84204]: System call of process 96578 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:39 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=106, name=volume-484b3d67-fc1d-4746-b176-cd09cf728cb1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 1073741824" returned: 0 in 0.767s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1" returned: 0 in 0.186s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:40 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] <== create_volume: return (1082ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:37:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.113s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1556bd44-8a75-4ef4-a6c1-0fac9dcc5f2c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-484b3d67-fc1d-4746-b176-cd09cf728cb1', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee1c70e-a64d-4bec-99ef-9245a0ee0129) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:37:40 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Volume volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 (484b3d67-fc1d-4746-b176-cd09cf728cb1): created successfully
Sep 24 18:37:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1ee1c70e-a64d-4bec-99ef-9245a0ee0129) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:37:40 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Flow 'volume_create_manager' (f1e1cd38-ea8c-4bdb-9f90-e86301f55aae) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:37:40 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d4ca63a0-13bb-468b-90c6-01a24c9223d1 tempest-VolumesSnapshotListTestJSON-1101348605 None] Created volume successfully.
Sep 24 18:37:42 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:37:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:42 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Creating offline snapshot 0245b144-833c-4b33-87ba-0b2952a431c8 of volume 484b3d67-fc1d-4746-b176-cd09cf728cb1 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:37:42 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d8cac93c-2814-4f43-9e09-ca38875c5538]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:37:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:43 devstack quobyte-client[84204]: System call of process 96603 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:43 devstack quobyte-client[84204]: System call of process 96603 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:43 devstack quobyte-client[84204]: System call of process 96603 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1" returned: 0 in 0.659s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:43 devstack quobyte-client[84204]: System call of process 96607 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:43 devstack quobyte-client[84204]: System call of process 96607 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:43 devstack quobyte-client[84204]: System call of process 96607 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:43 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=107, name=volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:37:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 1G" returned: 0 in 0.364s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): qemu-img rebase -u -b volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:43 devstack quobyte-client[84204]: System call of process 96612 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:43 devstack quobyte-client[84204]: System call of process 96612 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:43 devstack quobyte-client[84204]: System call of process 96612 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "qemu-img rebase -u -b volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8" returned: 0 in 0.402s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:37:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8" returned: 0 in 0.242s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:37:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8" returned: 0 in 0.152s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.info" returned: 0 in 0.274s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:37:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.info" returned: 0 in 0.165s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.879s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:45 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=48,cinder:SELECT=53,cinder:INSERT=27,cinder:DELETE=3 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:37:45 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=35,cinder:UPDATE=54,cinder:DELETE=6,cinder:INSERT=6 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:37:46 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-fe441335-df13-4333-91f9-9683a1524b1f tempest-VolumesSnapshotListTestJSON-1101348605 None] Create snapshot completed successfully
Sep 24 18:37:47 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:37:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Creating offline snapshot 55fcf7cb-a989-4ee5-8fb6-b16b3af1345d of volume 484b3d67-fc1d-4746-b176-cd09cf728cb1 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:37:47 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[da238ac0-d939-4f27-9d9e-1fa930d3b968]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:37:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:48 devstack quobyte-client[84204]: System call of process 96622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:48 devstack quobyte-client[84204]: System call of process 96622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:48 devstack quobyte-client[84204]: System call of process 96622 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8" returned: 0 in 1.108s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:48 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-484b3d67-fc1d-4746-b176-cd09cf728cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:37:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:48 devstack quobyte-client[84204]: System call of process 96626 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:49 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=109, name=volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:37:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d 1G" returned: 0 in 0.870s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): qemu-img rebase -u -b volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:49 devstack quobyte-client[84204]: System call of process 96629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:49 devstack quobyte-client[84204]: System call of process 96629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:49 devstack quobyte-client[84204]: System call of process 96629 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "qemu-img rebase -u -b volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d" returned: 0 in 0.400s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:37:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d" returned: 0 in 0.188s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:37:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d" returned: 0 in 0.217s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.737s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:51 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-df9f167a-a473-4d19-b421-f2754a5f4511 tempest-VolumesSnapshotListTestJSON-1101348605 None] Create snapshot completed successfully
Sep 24 18:37:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:37:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:37:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:37:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Creating offline snapshot 8da634c3-2cab-4d5d-8c21-3a0bd8931c80 of volume 484b3d67-fc1d-4746-b176-cd09cf728cb1 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:37:53 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e93f3930-659b-4b6d-b73b-be7eefedc528]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:37:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:54 devstack quobyte-client[84204]: System call of process 96639 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:54 devstack quobyte-client[84204]: System call of process 96639 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d" returned: 0 in 0.668s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-484b3d67-fc1d-4746-b176-cd09cf728cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:37:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:54 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=110, name=volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:37:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80 1G" returned: 0 in 0.361s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): qemu-img rebase -u -b volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:54 devstack quobyte-client[84204]: System call of process 96645 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:37:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "qemu-img rebase -u -b volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80" returned: 0 in 0.208s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:37:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80" returned: 0 in 0.184s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:37:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:37:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80" returned: 0 in 0.137s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:37:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.183s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:37:55 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-f579e185-8189-4de9-8a21-02ed6f5f7fe5 tempest-VolumesSnapshotListTestJSON-1101348605 None] Create snapshot completed successfully
Sep 24 18:37:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "cinder-8da634c3-2cab-4d5d-8c21-3a0bd8931c80-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:37:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-8da634c3-2cab-4d5d-8c21-3a0bd8931c80-delete_snapshot" acquired by "delete_snapshot" :: waited 0.025s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:37:59 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:37:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "cinder-quobyte-484b3d67-fc1d-4746-b176-cd09cf728cb1" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:37:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-484b3d67-fc1d-4746-b176-cd09cf728cb1" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:37:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "cinder-quobyte-8da634c3-2cab-4d5d-8c21-3a0bd8931c80" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:37:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-8da634c3-2cab-4d5d-8c21-3a0bd8931c80" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:37:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Deleting offline snapshot 8da634c3-2cab-4d5d-8c21-3a0bd8931c80 of volume 484b3d67-fc1d-4746-b176-cd09cf728cb1 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:37:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] snapshot_file for this snap is: volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:37:59 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[892d6799-fa15-4917-b940-6154bb85c2a2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:37:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:00 devstack quobyte-client[84204]: System call of process 96687 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80" returned: 0 in 0.616s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-484b3d67-fc1d-4746-b176-cd09cf728cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:38:00 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3d83051e-67de-4828-992a-b449375269c7]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:38:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:01 devstack quobyte-client[84204]: System call of process 96691 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:01 devstack quobyte-client[84204]: System call of process 96691 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:01 devstack quobyte-client[84204]: System call of process 96691 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d" returned: 0 in 0.825s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-484b3d67-fc1d-4746-b176-cd09cf728cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:38:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:01 devstack quobyte-client[84204]: System call of process 96694 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80" returned: 0 in 0.504s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.8da634c3-2cab-4d5d-8c21-3a0bd8931c80" returned: 0 in 0.160s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-8da634c3-2cab-4d5d-8c21-3a0bd8931c80" released by "_delete_snapshot" :: held 2.641s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-484b3d67-fc1d-4746-b176-cd09cf728cb1" released by "delete_snapshot" :: held 2.686s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:02 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Created reservations ['61d4284d-05c1-4158-81db-71744d91efca', '6bc8259a-846e-4b4c-bc8c-95bb42add809', '23b8dae9-8b68-4864-a111-a73cd4668689', '75da4396-99e1-453d-99d1-754b9b860382'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:38:03 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Delete snapshot completed successfully.
Sep 24 18:38:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a36a0938-82a8-47cb-bbb8-f373ddfc7b05 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-8da634c3-2cab-4d5d-8c21-3a0bd8931c80-delete_snapshot" released by "delete_snapshot" :: held 3.681s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-611a1595-43d3-4b39-a467-180f5a92ae31 req-00ef3269-a582-43a9-9847-f7c0165e024a tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:38:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-611a1595-43d3-4b39-a467-180f5a92ae31 req-00ef3269-a582-43a9-9847-f7c0165e024a tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:38:03 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fecc23bd-b9e2-4fb0-b06a-8118c3152521]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:38:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-611a1595-43d3-4b39-a467-180f5a92ae31 req-00ef3269-a582-43a9-9847-f7c0165e024a tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eece4abb-2fec-4363-9e87-801a8bfe3a34 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:04 devstack quobyte-client[84204]: System call of process 96706 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:04 devstack quobyte-client[84204]: System call of process 96706 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "cinder-55fcf7cb-a989-4ee5-8fb6-b16b3af1345d-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-611a1595-43d3-4b39-a467-180f5a92ae31 req-00ef3269-a582-43a9-9847-f7c0165e024a tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eece4abb-2fec-4363-9e87-801a8bfe3a34" returned: 0 in 0.634s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-611a1595-43d3-4b39-a467-180f5a92ae31 req-00ef3269-a582-43a9-9847-f7c0165e024a tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.666s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-55fcf7cb-a989-4ee5-8fb6-b16b3af1345d-delete_snapshot" acquired by "delete_snapshot" :: waited 0.268s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:04 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "cinder-quobyte-484b3d67-fc1d-4746-b176-cd09cf728cb1" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-611a1595-43d3-4b39-a467-180f5a92ae31 req-00ef3269-a582-43a9-9847-f7c0165e024a tempest-TestInstancesWithCinderVolumes-1528960685 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-eece4abb-2fec-4363-9e87-801a8bfe3a34', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '85037d0d-1dfc-46c5-ab60-87c13480da1a', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:38:04 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-611a1595-43d3-4b39-a467-180f5a92ae31 req-00ef3269-a582-43a9-9847-f7c0165e024a tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-484b3d67-fc1d-4746-b176-cd09cf728cb1" acquired by "delete_snapshot" :: waited 0.120s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "cinder-quobyte-55fcf7cb-a989-4ee5-8fb6-b16b3af1345d" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:04 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-611a1595-43d3-4b39-a467-180f5a92ae31 req-00ef3269-a582-43a9-9847-f7c0165e024a tempest-TestInstancesWithCinderVolumes-1528960685 None] attachment_update completed successfully.
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-55fcf7cb-a989-4ee5-8fb6-b16b3af1345d" acquired by "_delete_snapshot" :: waited 0.057s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Deleting offline snapshot 55fcf7cb-a989-4ee5-8fb6-b16b3af1345d of volume 484b3d67-fc1d-4746-b176-cd09cf728cb1 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] snapshot_file for this snap is: volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[5dcf8a20-10d5-4abb-a309-778053fc1315]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:38:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:05 devstack quobyte-client[84204]: System call of process 96709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:05 devstack quobyte-client[84204]: System call of process 96709 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d" returned: 0 in 0.460s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-484b3d67-fc1d-4746-b176-cd09cf728cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:38:05 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[16f0173d-bdc0-4d3d-8b53-0a265e8d5268]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:38:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8" returned: 0 in 0.634s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-484b3d67-fc1d-4746-b176-cd09cf728cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:38:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:06 devstack quobyte-client[84204]: System call of process 96721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:06 devstack quobyte-client[84204]: System call of process 96721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d" returned: 0 in 0.370s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.55fcf7cb-a989-4ee5-8fb6-b16b3af1345d" returned: 0 in 0.151s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-55fcf7cb-a989-4ee5-8fb6-b16b3af1345d" released by "_delete_snapshot" :: held 2.072s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-484b3d67-fc1d-4746-b176-cd09cf728cb1" released by "delete_snapshot" :: held 2.186s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:07 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Created reservations ['a04b88da-94b0-4bd6-81c0-d084b2882f28', 'ef2dc78d-d750-4f2a-a9a1-86045e716ce8', 'c830d2cb-916a-4ded-bf24-434b2b88b3db', '56abf510-2461-499e-a4cd-a3853f8e677f'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:38:07 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Delete snapshot completed successfully.
Sep 24 18:38:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-07d66576-4ee4-4cd9-b92c-0837e5c56e7e tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-55fcf7cb-a989-4ee5-8fb6-b16b3af1345d-delete_snapshot" released by "delete_snapshot" :: held 3.062s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "cinder-0245b144-833c-4b33-87ba-0b2952a431c8-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-0245b144-833c-4b33-87ba-0b2952a431c8-delete_snapshot" acquired by "delete_snapshot" :: waited 0.024s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:07 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:38:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "cinder-quobyte-484b3d67-fc1d-4746-b176-cd09cf728cb1" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-484b3d67-fc1d-4746-b176-cd09cf728cb1" acquired by "delete_snapshot" :: waited 0.014s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "cinder-quobyte-0245b144-833c-4b33-87ba-0b2952a431c8" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-0245b144-833c-4b33-87ba-0b2952a431c8" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:07 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Deleting offline snapshot 0245b144-833c-4b33-87ba-0b2952a431c8 of volume 484b3d67-fc1d-4746-b176-cd09cf728cb1 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:38:07 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] snapshot_file for this snap is: volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:38:07 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c4f15004-2975-44c3-b1cb-6caf933f9d4d]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:38:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:08 devstack quobyte-client[84204]: System call of process 96731 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8" returned: 0 in 0.549s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-484b3d67-fc1d-4746-b176-cd09cf728cb1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:38:08 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[71ca3454-5bf6-46a9-9525-3b2611d11d4a]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:38:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:08 devstack quobyte-client[84204]: System call of process 96734 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1" returned: 0 in 0.467s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:08 devstack quobyte-client[84204]: System call of process 96737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:08 devstack quobyte-client[84204]: System call of process 96737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:08 devstack quobyte-client[84204]: System call of process 96737 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8" returned: 0 in 0.325s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1.0245b144-833c-4b33-87ba-0b2952a431c8" returned: 0 in 0.119s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-0245b144-833c-4b33-87ba-0b2952a431c8" released by "_delete_snapshot" :: held 1.747s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-484b3d67-fc1d-4746-b176-cd09cf728cb1" released by "delete_snapshot" :: held 1.807s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:09 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Created reservations ['ae0bf05e-6ee6-4dfa-8aae-5ccf7bff1724', 'eaad2836-257a-41a9-b43a-a62efba9948c', '6602ecd3-71f3-4eb1-bdce-bcd139454d38', 'd34643c4-08bd-44af-a8ca-2119f741a731'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:38:09 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Delete snapshot completed successfully.
Sep 24 18:38:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a6ae7941-388b-450d-8ebb-dc9aea9a4b43 tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-0245b144-833c-4b33-87ba-0b2952a431c8-delete_snapshot" released by "delete_snapshot" :: held 2.230s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "cinder-484b3d67-fc1d-4746-b176-cd09cf728cb1-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-484b3d67-fc1d-4746-b176-cd09cf728cb1-delete_volume" acquired by "delete_volume" :: waited 0.028s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:11 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:38:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "cinder-quobyte-484b3d67-fc1d-4746-b176-cd09cf728cb1" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-484b3d67-fc1d-4746-b176-cd09cf728cb1" acquired by "delete_volume" :: waited 0.026s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:11 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[1cffa3ee-1869-4058-a231-9824b6efe4f8]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:38:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:11 devstack quobyte-client[84204]: System call of process 96747 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1" returned: 0 in 0.519s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-484b3d67-fc1d-4746-b176-cd09cf728cb1" returned: 0 in 0.114s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-quobyte-484b3d67-fc1d-4746-b176-cd09cf728cb1" released by "delete_volume" :: held 0.822s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Created reservations ['7c5bae17-1894-4f50-b37f-c2cb35864bfa', 'a4f4f9ca-d69d-4a26-89cf-63911e2955fd', '440cdd6c-b6da-457d-96fe-0b8af0215699', '0cf7f453-ae3b-4570-a943-ea1a8641cd6d'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.025s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.185s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.116s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:38:13 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Deleted volume successfully.
Sep 24 18:38:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9d84ab4d-8344-4f7a-9d80-e96024aa2d6b tempest-VolumesSnapshotListTestJSON-1101348605 None] Lock "cinder-484b3d67-fc1d-4746-b176-cd09cf728cb1-delete_volume" released by "delete_volume" :: held 2.151s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-ec74d716-a939-4417-be2c-fbbc5f7cebcf req-4fc75c4b-a38c-4c18-94ab-3e444876aa65 tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:38:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-ec74d716-a939-4417-be2c-fbbc5f7cebcf req-4fc75c4b-a38c-4c18-94ab-3e444876aa65 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:38:17 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6cceb9fb-efde-41b4-a978-ee9f01b6f531]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:38:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-ec74d716-a939-4417-be2c-fbbc5f7cebcf req-4fc75c4b-a38c-4c18-94ab-3e444876aa65 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-78b02221-13de-4c0b-9ded-5592c32711fe {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:18 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Flow 'volume_create_manager' (9d7b72b6-59f7-4e28-a559-efe1819cadfb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852dd835-0df8-4471-8e47-cc7e41ee7b2a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-ec74d716-a939-4417-be2c-fbbc5f7cebcf req-4fc75c4b-a38c-4c18-94ab-3e444876aa65 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-78b02221-13de-4c0b-9ded-5592c32711fe" returned: 0 in 0.870s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-ec74d716-a939-4417-be2c-fbbc5f7cebcf req-4fc75c4b-a38c-4c18-94ab-3e444876aa65 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.911s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (852dd835-0df8-4471-8e47-cc7e41ee7b2a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-28809874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2729f7d8-83ca-4d10-bf9f-faf4c7c68757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd248dcd35849eb89edc8e24f86decf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:38:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:38:18Z,use_quota=True,user_id='3c061bf76cd743baa1f8cb24bc6aebe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82962f1-6751-4e8e-ab66-d31608ac6349) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c82962f1-6751-4e8e-ab66-d31608ac6349) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a33f312-04ec-49aa-8000-34cfb73770fa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (2a33f312-04ec-49aa-8000-34cfb73770fa) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '2729f7d8-83ca-4d10-bf9f-faf4c7c68757', 'volume_name': 'volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757', 'volume_size': 2}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd6018e-24d7-4535-b25c-4a49ffb3b4bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4cd6018e-24d7-4535-b25c-4a49ffb3b4bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6268952-24ad-4f08-ad81-a746558186ef) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:38:18 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Volume 2729f7d8-83ca-4d10-bf9f-faf4c7c68757: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757', 'volume_size': 2}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:38:17Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-VolumesSnapshotNegativeTestJSON-Volume-28809874',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=2729f7d8-83ca-4d10-bf9f-faf4c7c68757,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='bcd248dcd35849eb89edc8e24f86decf',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:38:18Z,service_uuid=None,shared_targets=True,size=2,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:38:18Z,use_quota=True,user_id='3c061bf76cd743baa1f8cb24bc6aebe1',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Creating volume 2729f7d8-83ca-4d10-bf9f-faf4c7c68757 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:38:18 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 2147483648 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:18 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=111, name=volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:38:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-ec74d716-a939-4417-be2c-fbbc5f7cebcf req-4fc75c4b-a38c-4c18-94ab-3e444876aa65 tempest-TestInstancesWithCinderVolumes-1528960685 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-78b02221-13de-4c0b-9ded-5592c32711fe', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'a5e81d6a-ef01-4b51-84e2-d623043fad88', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:38:18 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-ec74d716-a939-4417-be2c-fbbc5f7cebcf req-4fc75c4b-a38c-4c18-94ab-3e444876aa65 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:38:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 2147483648" returned: 0 in 0.628s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757" returned: 0 in 0.262s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] <== create_volume: return (938ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:38:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.949s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:38:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b6268952-24ad-4f08-ad81-a746558186ef) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757', 'volume_size': 2}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:38:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0139390-a06e-4917-b4f1-1f29630ba256) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:38:19 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Volume volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 (2729f7d8-83ca-4d10-bf9f-faf4c7c68757): created successfully
Sep 24 18:38:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c0139390-a06e-4917-b4f1-1f29630ba256) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:38:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Flow 'volume_create_manager' (9d7b72b6-59f7-4e28-a559-efe1819cadfb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:38:19 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-ec74d716-a939-4417-be2c-fbbc5f7cebcf req-4fc75c4b-a38c-4c18-94ab-3e444876aa65 tempest-TestInstancesWithCinderVolumes-1528960685 None] attachment_update completed successfully.
Sep 24 18:38:19 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-30b6a547-0f5a-4634-b47d-2d8d387b5f41 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Created volume successfully.
Sep 24 18:38:20 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:38:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:38:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:38:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Creating offline snapshot 1bcdf97b-50e2-42f3-8e1f-28714ccee563 of volume 2729f7d8-83ca-4d10-bf9f-faf4c7c68757 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:38:20 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8d42066d-9310-4bb3-b83d-2ad4dfa0d214]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:38:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:20 devstack quobyte-client[84204]: System call of process 96775 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757" returned: 0 in 0.598s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563 2G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:21 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=112, name=volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:38:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563 2G" returned: 0 in 0.516s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): qemu-img rebase -u -b volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:21 devstack quobyte-client[84204]: System call of process 96787 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "qemu-img rebase -u -b volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563" returned: 0 in 0.182s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:38:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563" returned: 0 in 0.107s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:38:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563" returned: 0 in 0.093s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.info" returned: 0 in 0.110s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:38:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.info" returned: 0 in 0.121s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 2.137s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:38:22 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-eacfc47a-5a05-4034-9f20-f447796d1eb0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Create snapshot completed successfully
Sep 24 18:38:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Acquiring lock "cinder-1bcdf97b-50e2-42f3-8e1f-28714ccee563-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "cinder-1bcdf97b-50e2-42f3-8e1f-28714ccee563-delete_snapshot" acquired by "delete_snapshot" :: waited 0.054s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:23 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:38:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Acquiring lock "cinder-quobyte-2729f7d8-83ca-4d10-bf9f-faf4c7c68757" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "cinder-quobyte-2729f7d8-83ca-4d10-bf9f-faf4c7c68757" acquired by "delete_snapshot" :: waited 0.011s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Acquiring lock "cinder-quobyte-1bcdf97b-50e2-42f3-8e1f-28714ccee563" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "cinder-quobyte-1bcdf97b-50e2-42f3-8e1f-28714ccee563" acquired by "_delete_snapshot" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:23 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Deleting offline snapshot 1bcdf97b-50e2-42f3-8e1f-28714ccee563 of volume 2729f7d8-83ca-4d10-bf9f-faf4c7c68757 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:38:23 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] snapshot_file for this snap is: volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:38:23 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8cfd5bc7-2e83-4b40-9946-7078b04e6079]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:38:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:24 devstack quobyte-client[84204]: System call of process 96794 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:38:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563" returned: 0 in 0.414s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:38:24 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[dda97086-5508-465f-8ddc-78a6f8e677fd]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:38:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757" returned: 0 in 0.554s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563" returned: 0 in 0.268s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757.1bcdf97b-50e2-42f3-8e1f-28714ccee563" returned: 0 in 0.094s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "cinder-quobyte-1bcdf97b-50e2-42f3-8e1f-28714ccee563" released by "_delete_snapshot" :: held 1.667s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "cinder-quobyte-2729f7d8-83ca-4d10-bf9f-faf4c7c68757" released by "delete_snapshot" :: held 1.692s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:25 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Created reservations ['ccdc2584-655e-40b5-8cd9-570b4b010dba', 'f16981ac-4f43-4776-b90d-7a86299f5afa', '1567bab5-ec71-4dc5-997a-9a5786907c76', 'd8cfed9b-2a64-41a2-8a7f-6d6af77537f2'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:38:26 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Delete snapshot completed successfully.
Sep 24 18:38:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3ad1a6ee-6cc6-4c5d-8241-a40048de75c0 tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "cinder-1bcdf97b-50e2-42f3-8e1f-28714ccee563-delete_snapshot" released by "delete_snapshot" :: held 2.302s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Acquiring lock "cinder-2729f7d8-83ca-4d10-bf9f-faf4c7c68757-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "cinder-2729f7d8-83ca-4d10-bf9f-faf4c7c68757-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:27 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:38:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Acquiring lock "cinder-quobyte-2729f7d8-83ca-4d10-bf9f-faf4c7c68757" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:38:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "cinder-quobyte-2729f7d8-83ca-4d10-bf9f-faf4c7c68757" acquired by "delete_volume" :: waited 0.014s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:38:27 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fc198a03-983e-46f2-95ad-cfdd774ed8a9]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:38:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757" returned: 0 in 0.503s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-2729f7d8-83ca-4d10-bf9f-faf4c7c68757" returned: 0 in 0.130s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:28 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "cinder-quobyte-2729f7d8-83ca-4d10-bf9f-faf4c7c68757" released by "delete_volume" :: held 0.865s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:28 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Created reservations ['0e4e6040-05cb-4263-bb9d-402288299997', '906c49a4-51ce-4809-b236-5a4415e2df95', 'a137acba-a675-4f48-9b2b-3324fcdcc3ba', '52155593-6bac-452f-817b-1de472dee692'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:38:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:38:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:38:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:38:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:38:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:38:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:38:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.111s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:38:28 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:38:28 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Deleted volume successfully.
Sep 24 18:38:28 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5dd1a3bc-e5c5-4e31-953e-9bdabe291f3d tempest-VolumesSnapshotNegativeTestJSON-1169526952 None] Lock "cinder-2729f7d8-83ca-4d10-bf9f-faf4c7c68757-delete_volume" released by "delete_volume" :: held 1.834s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:38:38 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=43,cinder:UPDATE=51,cinder:DELETE=2,cinder:INSERT=13 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:38:38 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:DELETE=5,cinder:UPDATE=41,cinder:SELECT=46,cinder:INSERT=11 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:38:56 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-0bd4d52c-8434-4696-bcbb-18b20ebd6624 req-d36a5cdc-4b7b-4adc-bc85-dd9d12ad8b71 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:38:56 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-0bd4d52c-8434-4696-bcbb-18b20ebd6624 req-d36a5cdc-4b7b-4adc-bc85-dd9d12ad8b71 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:38:56 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-0bd4d52c-8434-4696-bcbb-18b20ebd6624 req-d36a5cdc-4b7b-4adc-bc85-dd9d12ad8b71 tempest-TestInstancesWithCinderVolumes-1528960685 None] Terminate volume connection completed successfully.
Sep 24 18:38:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-0bd4d52c-8434-4696-bcbb-18b20ebd6624 req-d36a5cdc-4b7b-4adc-bc85-dd9d12ad8b71 tempest-TestInstancesWithCinderVolumes-1528960685 None] Deleting attachment 85037d0d-1dfc-46c5-ab60-87c13480da1a. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:38:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "cinder-eece4abb-2fec-4363-9e87-801a8bfe3a34-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:39:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "cinder-eece4abb-2fec-4363-9e87-801a8bfe3a34-delete_volume" acquired by "delete_volume" :: waited 0.323s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:39:00 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:39:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "cinder-quobyte-eece4abb-2fec-4363-9e87-801a8bfe3a34" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:39:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "cinder-quobyte-eece4abb-2fec-4363-9e87-801a8bfe3a34" acquired by "delete_volume" :: waited 0.055s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:39:00 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[da51702f-66a2-42b8-bc25-871b548ffaf8]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:39:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eece4abb-2fec-4363-9e87-801a8bfe3a34 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:02 devstack quobyte-client[84204]: System call of process 96982 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:39:02 devstack quobyte-client[84204]: System call of process 96982 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:39:02 devstack quobyte-client[84204]: System call of process 96982 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:39:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eece4abb-2fec-4363-9e87-801a8bfe3a34" returned: 0 in 1.381s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eece4abb-2fec-4363-9e87-801a8bfe3a34 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-eece4abb-2fec-4363-9e87-801a8bfe3a34" returned: 0 in 0.157s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "cinder-quobyte-eece4abb-2fec-4363-9e87-801a8bfe3a34" released by "delete_volume" :: held 1.952s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:39:03 devstack cinder-volume[84177]: WARNING cinder.quota [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-529693843-564062354 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-529693843-564062354, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:39:03 devstack cinder-volume[84177]: WARNING cinder.quota [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-529693843-564062354 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-529693843-564062354, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:39:03 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Created reservations ['053b4ac1-0bb9-48b0-9db2-fda1c3bbdf99', 'daf0175e-5110-4ac3-9c29-7e99a755a58a', 'd032a832-ab60-4a37-8483-8e13d22e4027', '1337d327-02a4-42de-82b7-b802177db0c0'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:39:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:39:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:39:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:39:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:39:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:39:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.189s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:04 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:39:04 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Deleted volume successfully.
Sep 24 18:39:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-57534c17-8b51-4750-9501-6e557680cf10 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "cinder-eece4abb-2fec-4363-9e87-801a8bfe3a34-delete_volume" released by "delete_volume" :: held 4.980s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:39:06 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-726fcc44-6e88-4421-93aa-473e8dfac4b5 req-aef7b045-8f26-4ca3-aec5-a71be45908b6 tempest-TestShelveInstance-82699032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:39:06 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-726fcc44-6e88-4421-93aa-473e8dfac4b5 req-aef7b045-8f26-4ca3-aec5-a71be45908b6 tempest-TestShelveInstance-82699032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:39:06 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-726fcc44-6e88-4421-93aa-473e8dfac4b5 req-aef7b045-8f26-4ca3-aec5-a71be45908b6 tempest-TestShelveInstance-82699032 None] Terminate volume connection completed successfully.
Sep 24 18:39:06 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-726fcc44-6e88-4421-93aa-473e8dfac4b5 req-aef7b045-8f26-4ca3-aec5-a71be45908b6 tempest-TestShelveInstance-82699032 None] Deleting attachment c7e9f33a-309c-48d7-92a4-bfc91992b2b1. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:39:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:39:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:39:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:39:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:39:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:39:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:39:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.171s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:39:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-4f4083a6-0509-410e-8045-a36566e47a09 req-0858dc06-0f06-4b10-8b5d-f1a3c2c87ebe tempest-TestShelveInstance-82699032 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:39:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-4f4083a6-0509-410e-8045-a36566e47a09 req-0858dc06-0f06-4b10-8b5d-f1a3c2c87ebe tempest-TestShelveInstance-82699032 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:39:13 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[92e87566-2ce3-499b-8d1f-1873fceafe08]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:39:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-4f4083a6-0509-410e-8045-a36566e47a09 req-0858dc06-0f06-4b10-8b5d-f1a3c2c87ebe tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-4f4083a6-0509-410e-8045-a36566e47a09 req-0858dc06-0f06-4b10-8b5d-f1a3c2c87ebe tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" returned: 0 in 0.510s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-4f4083a6-0509-410e-8045-a36566e47a09 req-0858dc06-0f06-4b10-8b5d-f1a3c2c87ebe tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:15 devstack quobyte-client[84204]: System call of process 97038 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:39:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-4f4083a6-0509-410e-8045-a36566e47a09 req-0858dc06-0f06-4b10-8b5d-f1a3c2c87ebe tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" returned: 1 in 0.868s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-4f4083a6-0509-410e-8045-a36566e47a09 req-0858dc06-0f06-4b10-8b5d-f1a3c2c87ebe tempest-TestShelveInstance-82699032 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:39:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-4f4083a6-0509-410e-8045-a36566e47a09 req-0858dc06-0f06-4b10-8b5d-f1a3c2c87ebe tempest-TestShelveInstance-82699032 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.634s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:39:15 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-4f4083a6-0509-410e-8045-a36566e47a09 req-0858dc06-0f06-4b10-8b5d-f1a3c2c87ebe tempest-TestShelveInstance-82699032 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88', 'options': None, 'format': 'raw', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e0a2c121-a847-4a78-b0fe-03d7f191e585', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:39:15 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-4f4083a6-0509-410e-8045-a36566e47a09 req-0858dc06-0f06-4b10-8b5d-f1a3c2c87ebe tempest-TestShelveInstance-82699032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:39:15 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-4f4083a6-0509-410e-8045-a36566e47a09 req-0858dc06-0f06-4b10-8b5d-f1a3c2c87ebe tempest-TestShelveInstance-82699032 None] attachment_update completed successfully.
Sep 24 18:39:25 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=10,cinder:UPDATE=11,cinder:INSERT=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:39:25 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=15,cinder:INSERT=3,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:39:28 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-d504b84e-2649-48d2-83b9-2c7eb3aed2be req-b3097eef-bb1b-4951-98b8-27374510a7c5 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:39:29 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-d504b84e-2649-48d2-83b9-2c7eb3aed2be req-b3097eef-bb1b-4951-98b8-27374510a7c5 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:39:29 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-d504b84e-2649-48d2-83b9-2c7eb3aed2be req-b3097eef-bb1b-4951-98b8-27374510a7c5 tempest-TestInstancesWithCinderVolumes-1528960685 None] Terminate volume connection completed successfully.
Sep 24 18:39:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-d504b84e-2649-48d2-83b9-2c7eb3aed2be req-b3097eef-bb1b-4951-98b8-27374510a7c5 tempest-TestInstancesWithCinderVolumes-1528960685 None] Deleting attachment a5e81d6a-ef01-4b51-84e2-d623043fad88. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:39:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "cinder-78b02221-13de-4c0b-9ded-5592c32711fe-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:39:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "cinder-78b02221-13de-4c0b-9ded-5592c32711fe-delete_volume" acquired by "delete_volume" :: waited 0.111s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:39:31 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:39:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "cinder-quobyte-78b02221-13de-4c0b-9ded-5592c32711fe" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:39:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "cinder-quobyte-78b02221-13de-4c0b-9ded-5592c32711fe" acquired by "delete_volume" :: waited 0.047s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:39:31 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[12f25b49-dd7d-4a27-bbab-894df05df240]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:39:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-78b02221-13de-4c0b-9ded-5592c32711fe {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:33 devstack quobyte-client[84204]: System call of process 97197 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:39:33 devstack quobyte-client[84204]: System call of process 97197 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:39:33 devstack quobyte-client[84204]: System call of process 97197 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:39:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-78b02221-13de-4c0b-9ded-5592c32711fe" returned: 0 in 1.826s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-78b02221-13de-4c0b-9ded-5592c32711fe {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-78b02221-13de-4c0b-9ded-5592c32711fe" returned: 0 in 0.361s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "cinder-quobyte-78b02221-13de-4c0b-9ded-5592c32711fe" released by "delete_volume" :: held 3.052s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:39:35 devstack cinder-volume[84177]: WARNING cinder.quota [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1432534100-220501345 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1432534100-220501345, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:39:35 devstack cinder-volume[84177]: WARNING cinder.quota [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1432534100-220501345 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-1432534100-220501345, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:39:35 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Created reservations ['18cc4c9d-4511-412a-9f53-f26b6c87c74b', '4f255fe3-89f5-4170-9a92-5e0256d10e41', '79b832b3-9547-4865-a4d5-7751297c6949', '3d8af7c2-3a40-422c-8cd8-303fc5eeae14'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:39:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:39:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.022s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:39:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:39:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:39:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.102s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:39:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.396s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:36 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:39:36 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Deleted volume successfully.
Sep 24 18:39:37 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-937b1500-8fa0-4681-bad9-34eeb56e95cd tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "cinder-78b02221-13de-4c0b-9ded-5592c32711fe-delete_volume" released by "delete_volume" :: held 6.161s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:39:47 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=9,cinder:UPDATE=8,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:39:47 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=4,cinder:UPDATE=9 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:39:49 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-7fd20f76-309a-4c3e-a1ff-b5fcb1eda991 req-578a15a9-8add-480e-afd3-5c59ffc0556a tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:39:49 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-7fd20f76-309a-4c3e-a1ff-b5fcb1eda991 req-578a15a9-8add-480e-afd3-5c59ffc0556a tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:39:49 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-7fd20f76-309a-4c3e-a1ff-b5fcb1eda991 req-578a15a9-8add-480e-afd3-5c59ffc0556a tempest-TestInstancesWithCinderVolumes-1528960685 None] Terminate volume connection completed successfully.
Sep 24 18:39:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-7fd20f76-309a-4c3e-a1ff-b5fcb1eda991 req-578a15a9-8add-480e-afd3-5c59ffc0556a tempest-TestInstancesWithCinderVolumes-1528960685 None] Deleting attachment 717fc5af-e345-4869-b109-eeaca3632c71. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:39:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "cinder-c20a9d20-d224-4914-9091-346e374060d9-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:39:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "cinder-c20a9d20-d224-4914-9091-346e374060d9-delete_volume" acquired by "delete_volume" :: waited 0.056s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:39:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:39:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "cinder-quobyte-c20a9d20-d224-4914-9091-346e374060d9" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:39:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "cinder-quobyte-c20a9d20-d224-4914-9091-346e374060d9" acquired by "delete_volume" :: waited 0.051s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:39:53 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[49641ce2-f6a1-41e3-8840-f961fe25e801]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:39:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9" returned: 0 in 0.947s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:55 devstack quobyte-client[84204]: System call of process 97284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:39:55 devstack quobyte-client[84204]: System call of process 97284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:39:55 devstack quobyte-client[84204]: System call of process 97284 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:39:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9" returned: 1 in 0.682s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:39:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-c20a9d20-d224-4914-9091-346e374060d9" returned: 0 in 0.243s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "cinder-quobyte-c20a9d20-d224-4914-9091-346e374060d9" released by "delete_volume" :: held 2.721s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:39:56 devstack cinder-volume[84177]: WARNING cinder.quota [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Deprecated: Default quota for resource: volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2058260149-1448898888 is set by the default quota flag: quota_volumes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2058260149-1448898888, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:39:56 devstack cinder-volume[84177]: WARNING cinder.quota [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Deprecated: Default quota for resource: gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2058260149-1448898888 is set by the default quota flag: quota_gigabytes_tempest-scenario-type-tempest-TestInstancesWithCinderVolumes-volume-type-2058260149-1448898888, it is now deprecated. Please use the default quota class for default quota.
Sep 24 18:39:56 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Created reservations ['1280e17f-7404-4382-a8e6-40b07cac0426', 'e60405be-0357-4ba6-a37c-3952ae50bb28', '7c0ab4c2-65da-4eb1-9a2c-e0d480da03e3', '5e7c0507-5d1b-43f2-b849-771f08d54387'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:39:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:39:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:39:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:39:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:39:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.030s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:39:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:39:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.168s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:39:57 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:39:57 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Deleted volume successfully.
Sep 24 18:39:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-dd189231-2821-4b88-a472-03b816d8f960 tempest-TestInstancesWithCinderVolumes-1528960685 None] Lock "cinder-c20a9d20-d224-4914-9091-346e374060d9-delete_volume" released by "delete_volume" :: held 4.995s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:40:06 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=7,cinder:INSERT=3,cinder:UPDATE=7 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:40:07 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=5,cinder:UPDATE=9,cinder:INSERT=1,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:40:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:40:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:40:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:40:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:40:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:40:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.091s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:40:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:40:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.176s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:40:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:40:44 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Flow 'volume_create_manager' (77513202-c17a-4815-9f34-8143ce20efba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee492a6-1f93-4f1c-bb85-5fa774bb8dcb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2ee492a6-1f93-4f1c-bb85-5fa774bb8dcb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-373891701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db33482-6583-49a5-87ed-12dec170aa29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304805d9296e4098a74d5acbad58a842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:40:43Z,use_quota=True,user_id='ba8975e7a6494d7eb80ebf2105b15b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9497354f-937c-48c5-8caf-b753f1baedb2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9497354f-937c-48c5-8caf-b753f1baedb2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd40b593-1d54-4082-b898-cb712b4fa0a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd40b593-1d54-4082-b898-cb712b4fa0a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5db33482-6583-49a5-87ed-12dec170aa29', 'volume_name': 'volume-5db33482-6583-49a5-87ed-12dec170aa29', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16827f5c-a8e1-49aa-aa07-ce1f13899ca7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (16827f5c-a8e1-49aa-aa07-ce1f13899ca7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b1bf37-c2e3-43e7-bbf3-cc56c2f53f7a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:40:44 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Volume 5db33482-6583-49a5-87ed-12dec170aa29: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5db33482-6583-49a5-87ed-12dec170aa29', 'volume_size': 1}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:40:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachScenarioOldVersion-volume-373891701',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5db33482-6583-49a5-87ed-12dec170aa29,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='304805d9296e4098a74d5acbad58a842',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:40:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:40:43Z,use_quota=True,user_id='ba8975e7a6494d7eb80ebf2105b15b23',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Creating volume 5db33482-6583-49a5-87ed-12dec170aa29 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:40:44 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:40:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5db33482-6583-49a5-87ed-12dec170aa29 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:40:44 devstack quobyte-client[84204]: System call of process 97410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:40:44 devstack quobyte-client[84204]: System call of process 97410 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:40:45 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=114, name=volume-5db33482-6583-49a5-87ed-12dec170aa29, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:40:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5db33482-6583-49a5-87ed-12dec170aa29 1073741824" returned: 0 in 0.648s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:40:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5db33482-6583-49a5-87ed-12dec170aa29 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:40:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5db33482-6583-49a5-87ed-12dec170aa29" returned: 0 in 0.179s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:40:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] <== create_volume: return (929ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:40:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.971s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:40:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39b1bf37-c2e3-43e7-bbf3-cc56c2f53f7a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5db33482-6583-49a5-87ed-12dec170aa29', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:40:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8277fefe-87b0-404a-a87c-c75c66a502e2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:40:46 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Volume volume-5db33482-6583-49a5-87ed-12dec170aa29 (5db33482-6583-49a5-87ed-12dec170aa29): created successfully
Sep 24 18:40:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8277fefe-87b0-404a-a87c-c75c66a502e2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:40:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Flow 'volume_create_manager' (77513202-c17a-4815-9f34-8143ce20efba) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:40:46 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-72467e08-a32c-419e-9f07-30b16b1aa3a6 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Created volume successfully.
Sep 24 18:40:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-124196c4-ea08-4938-b62e-e0497b0c49aa req-dcee19e6-ddc3-40d5-86f8-e8b16508b484 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:40:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-124196c4-ea08-4938-b62e-e0497b0c49aa req-dcee19e6-ddc3-40d5-86f8-e8b16508b484 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:40:52 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[27645222-e21c-499f-aed1-786f2dc107af]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:40:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-124196c4-ea08-4938-b62e-e0497b0c49aa req-dcee19e6-ddc3-40d5-86f8-e8b16508b484 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5db33482-6583-49a5-87ed-12dec170aa29 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:40:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-124196c4-ea08-4938-b62e-e0497b0c49aa req-dcee19e6-ddc3-40d5-86f8-e8b16508b484 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5db33482-6583-49a5-87ed-12dec170aa29" returned: 0 in 0.527s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:40:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-124196c4-ea08-4938-b62e-e0497b0c49aa req-dcee19e6-ddc3-40d5-86f8-e8b16508b484 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.614s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:40:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-124196c4-ea08-4938-b62e-e0497b0c49aa req-dcee19e6-ddc3-40d5-86f8-e8b16508b484 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-5db33482-6583-49a5-87ed-12dec170aa29', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '5fd4b82c-0f89-4267-b1dc-2590110af7a8', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:40:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-124196c4-ea08-4938-b62e-e0497b0c49aa req-dcee19e6-ddc3-40d5-86f8-e8b16508b484 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:40:53 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-124196c4-ea08-4938-b62e-e0497b0c49aa req-dcee19e6-ddc3-40d5-86f8-e8b16508b484 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] attachment_update completed successfully.
Sep 24 18:40:54 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-de80534d-efdd-4560-8350-2eef816bd775 req-63ceb2cd-d873-45e8-8cea-bdb0b276ac7b tempest-TestShelveInstance-82699032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:40:54 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-de80534d-efdd-4560-8350-2eef816bd775 req-63ceb2cd-d873-45e8-8cea-bdb0b276ac7b tempest-TestShelveInstance-82699032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:40:54 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-de80534d-efdd-4560-8350-2eef816bd775 req-63ceb2cd-d873-45e8-8cea-bdb0b276ac7b tempest-TestShelveInstance-82699032 None] Terminate volume connection completed successfully.
Sep 24 18:40:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-de80534d-efdd-4560-8350-2eef816bd775 req-63ceb2cd-d873-45e8-8cea-bdb0b276ac7b tempest-TestShelveInstance-82699032 None] Deleting attachment e0a2c121-a847-4a78-b0fe-03d7f191e585. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:40:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Acquiring lock "cinder-aa0f5e2b-c1e8-4c52-8774-f723bd24af88-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:40:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Lock "cinder-aa0f5e2b-c1e8-4c52-8774-f723bd24af88-delete_volume" acquired by "delete_volume" :: waited 0.118s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:40:56 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:40:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Acquiring lock "cinder-quobyte-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:40:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Lock "cinder-quobyte-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" acquired by "delete_volume" :: waited 0.015s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:40:56 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0ca44ee3-33fb-4532-a038-da0473816093]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:40:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:40:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" returned: 0 in 1.366s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:40:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:40:58 devstack quobyte-client[84204]: System call of process 97869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:40:58 devstack quobyte-client[84204]: System call of process 97869 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:40:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" returned: 1 in 0.896s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:40:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:40:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:40:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" returned: 0 in 0.161s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:40:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Lock "cinder-quobyte-aa0f5e2b-c1e8-4c52-8774-f723bd24af88" released by "delete_volume" :: held 3.135s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:40:59 devstack cinder-volume[84177]: DEBUG cinder.quota [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Created reservations ['72256ec1-a50f-4477-8bd5-f6d1a0bb840a', '21d633d1-6423-42c4-8f37-eb02423ce790', '343d57e3-f1f0-4011-92c6-a309718e16e5', '0a15a891-be9c-472e-abae-8e999c9d663e'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:41:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:41:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:41:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:41:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:41:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:41:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.152s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:00 devstack cinder-volume[84177]: DEBUG cinder.manager [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:41:00 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Deleted volume successfully.
Sep 24 18:41:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [req-de80534d-efdd-4560-8350-2eef816bd775 req-87de16b3-72a9-4560-9f85-91b4f3b6b659 tempest-TestShelveInstance-82699032 None] Lock "cinder-aa0f5e2b-c1e8-4c52-8774-f723bd24af88-delete_volume" released by "delete_volume" :: held 4.739s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:41:10 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=17,cinder:UPDATE=14,cinder:INSERT=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:41:10 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=8,cinder:UPDATE=9,cinder:DELETE=2,cinder:INSERT=3 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:41:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:41:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:41:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:41:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:41:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:41:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.049s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:41:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.277s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:41:21 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Flow 'volume_create_manager' (ef3c1377-28ca-4168-85bf-2cad4d8ba046) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50064c62-2305-40bb-9ccd-6282ab36e5b9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (50064c62-2305-40bb-9ccd-6282ab36e5b9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1003816868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b32a1ea-50af-4994-8f16-d8e6ec79b2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeeee8da676e4793ac36e9547398cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:41:21Z,use_quota=True,user_id='214cdfa97ecc4a62977535ad53c22264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c349973-eeec-4f23-8768-31bb3e69e6bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2c349973-eeec-4f23-8768-31bb3e69e6bd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f079904-eaf8-44f0-85be-7453b7680733) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0f079904-eaf8-44f0-85be-7453b7680733) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '4b32a1ea-50af-4994-8f16-d8e6ec79b2bb', 'volume_name': 'volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d9a438-3f1c-49ab-a0cd-faccc1ff5e9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b2d9a438-3f1c-49ab-a0cd-faccc1ff5e9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6ee6ac-c482-4615-ad10-03879e0848b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:41:21 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Volume 4b32a1ea-50af-4994-8f16-d8e6ec79b2bb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb', 'volume_size': 1}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:41:21Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestMinimumBasicScenario-volume-1003816868',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4b32a1ea-50af-4994-8f16-d8e6ec79b2bb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='eeeee8da676e4793ac36e9547398cdbe',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:41:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:41:21Z,use_quota=True,user_id='214cdfa97ecc4a62977535ad53c22264',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Creating volume 4b32a1ea-50af-4994-8f16-d8e6ec79b2bb {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:41:21 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:21 devstack quobyte-client[84204]: System call of process 98069 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:21 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=115, name=volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb 1073741824" returned: 0 in 0.383s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb" returned: 0 in 0.154s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] <== create_volume: return (698ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:41:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.714s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:41:22 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (1d6ee6ac-c482-4615-ad10-03879e0848b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:41:22 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1a9f30-e90b-4851-9e0a-e5016e884ae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:41:22 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Volume volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb (4b32a1ea-50af-4994-8f16-d8e6ec79b2bb): created successfully
Sep 24 18:41:22 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (1c1a9f30-e90b-4851-9e0a-e5016e884ae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:41:22 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Flow 'volume_create_manager' (ef3c1377-28ca-4168-85bf-2cad4d8ba046) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:41:22 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1605c211-569f-4288-8408-ce2d06332abb tempest-TestMinimumBasicScenario-1140205600 None] Created volume successfully.
Sep 24 18:41:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-80d0a377-0be3-421f-877b-244c597998e9 req-5792f563-372a-4310-a74f-ce83a15d9707 tempest-TestMinimumBasicScenario-1140205600 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:41:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-80d0a377-0be3-421f-877b-244c597998e9 req-5792f563-372a-4310-a74f-ce83a15d9707 tempest-TestMinimumBasicScenario-1140205600 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:41:27 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[59c3ad0c-be54-45e4-bc2f-8273fe591466]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:41:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-80d0a377-0be3-421f-877b-244c597998e9 req-5792f563-372a-4310-a74f-ce83a15d9707 tempest-TestMinimumBasicScenario-1140205600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:28 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:41:28 devstack quobyte-client[84204]: System call of process 98081 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:28 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Flow 'volume_create_manager' (2558499c-9f67-4eef-b8de-9d582cb32dfd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec54b5dd-b70c-4013-8210-bff87ccb735b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:41:29 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-cea77675-758c-4a82-baee-22e941f2be79 req-fd6860b4-94c0-4ab3-a403-33622b97be91 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ec54b5dd-b70c-4013-8210-bff87ccb735b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9ac25f-63b3-45c6-90e5-f2c751b5f5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba0ab1c7c114caf9abad6686c980b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:41:28Z,use_quota=True,user_id='533d238f3a23495690e5a8750e686bf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64e74ab-a5f5-431e-9044-75cb2a047d53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a64e74ab-a5f5-431e-9044-75cb2a047d53) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4beb3d74-56e0-42f8-8962-34065bcd60bb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.image.glance [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Creating Keystone auth plugin from conf {{(pid=84177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-80d0a377-0be3-421f-877b-244c597998e9 req-5792f563-372a-4310-a74f-ce83a15d9707 tempest-TestMinimumBasicScenario-1140205600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb" returned: 0 in 1.442s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:29 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-cea77675-758c-4a82-baee-22e941f2be79 req-fd6860b4-94c0-4ab3-a403-33622b97be91 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:41:29 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-cea77675-758c-4a82-baee-22e941f2be79 req-fd6860b4-94c0-4ab3-a403-33622b97be91 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Terminate volume connection completed successfully.
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-cea77675-758c-4a82-baee-22e941f2be79 req-fd6860b4-94c0-4ab3-a403-33622b97be91 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Deleting attachment 5fd4b82c-0f89-4267-b1dc-2590110af7a8. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-80d0a377-0be3-421f-877b-244c597998e9 req-5792f563-372a-4310-a74f-ce83a15d9707 tempest-TestMinimumBasicScenario-1140205600 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.593s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-80d0a377-0be3-421f-877b-244c597998e9 req-5792f563-372a-4310-a74f-ce83a15d9707 tempest-TestMinimumBasicScenario-1140205600 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '10534d6d-48bd-43c8-9e02-70347a6b58a8', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:41:29 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-80d0a377-0be3-421f-877b-244c597998e9 req-5792f563-372a-4310-a74f-ce83a15d9707 tempest-TestMinimumBasicScenario-1140205600 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:41:29 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-80d0a377-0be3-421f-877b-244c597998e9 req-5792f563-372a-4310-a74f-ce83a15d9707 tempest-TestMinimumBasicScenario-1140205600 None] attachment_update completed successfully.
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (4beb3d74-56e0-42f8-8962-34065bcd60bb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '7c9ac25f-63b3-45c6-90e5-f2c751b5f5af', 'volume_name': 'volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af', 'volume_size': 1, 'image_id': 'dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da806744bf8d922466c871e92320a94c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dba0ab1c7c114caf9abad6686c980b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d852c90e8519bf20eb8512708741d55dbc925320228514e4cf36414341a64d15f42dec5711eafba3e13672cf62f04a853931beb828915351832129955acab89', 'id': 'dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'created_at': datetime.datetime(2025, 9, 24, 16, 41, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 41, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dabd6069-2fcf-41d5-9811-492a6a9aad0f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029d4b820>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3996760-8c83-4735-8df4-b7102078c794) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e3996760-8c83-4735-8df4-b7102078c794) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c95512-b557-4af1-bce8-d89ec1d88a06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:41:29 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Volume 7c9ac25f-63b3-45c6-90e5-f2c751b5f5af: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af', 'volume_size': 1, 'image_id': 'dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da806744bf8d922466c871e92320a94c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dba0ab1c7c114caf9abad6686c980b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d852c90e8519bf20eb8512708741d55dbc925320228514e4cf36414341a64d15f42dec5711eafba3e13672cf62f04a853931beb828915351832129955acab89', 'id': 'dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'created_at': datetime.datetime(2025, 9, 24, 16, 41, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 41, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dabd6069-2fcf-41d5-9811-492a6a9aad0f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029d4b820>}
Sep 24 18:41:29 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Cloning 7c9ac25f-63b3-45c6-90e5-f2c751b5f5af from image dabd6069-2fcf-41d5-9811-492a6a9aad0f  at location (None, [{'url': 'file:///opt/stack/data/glance/images/dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'metadata': {}}]). {{(pid=84177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 18:41:30 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 18:41:30 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Image download 0.00 MB at 0.00 MB/s
Sep 24 18:41:30 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9cdc0a5c-17cc-466a-af87-bcf960a5e04a]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:41:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:30 devstack sudo[98086]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD
Sep 24 18:41:30 devstack sudo[98086]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:41:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Acquiring lock "cinder-5db33482-6583-49a5-87ed-12dec170aa29-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:41:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Lock "cinder-5db33482-6583-49a5-87ed-12dec170aa29-delete_volume" acquired by "delete_volume" :: waited 0.052s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:41:31 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:41:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Acquiring lock "cinder-quobyte-5db33482-6583-49a5-87ed-12dec170aa29" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:41:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Lock "cinder-quobyte-5db33482-6583-49a5-87ed-12dec170aa29" acquired by "delete_volume" :: waited 0.039s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:41:32 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2ace58e2-3683-4669-80e6-fbbefbf1d821]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:41:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5db33482-6583-49a5-87ed-12dec170aa29 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:33 devstack quobyte-client[84204]: System call of process 98470 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:33 devstack quobyte-client[84204]: System call of process 98470 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:33 devstack quobyte-client[84204]: System call of process 98470 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:33 devstack quobyte-client[84204]: System call of process 98470 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5db33482-6583-49a5-87ed-12dec170aa29" returned: 0 in 1.226s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5db33482-6583-49a5-87ed-12dec170aa29 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5db33482-6583-49a5-87ed-12dec170aa29" returned: 0 in 0.275s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:33 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Lock "cinder-quobyte-5db33482-6583-49a5-87ed-12dec170aa29" released by "delete_volume" :: held 2.011s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:41:34 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Created reservations ['f114b196-bd38-40fb-a851-686e9c08128b', 'd3255872-c748-438a-9825-4ebb137396cd', '0ba67a05-5c2c-4c60-b3f7-70365cef5b3d', '4c0e7708-11d5-4659-b30c-239a4beda812'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:41:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:41:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.024s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:41:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:41:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:41:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.037s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:41:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:35 devstack sudo[98086]: pam_unix(sudo:session): session closed for user root
Sep 24 18:41:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.263s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:35 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:41:35 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Deleted volume successfully.
Sep 24 18:41:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD" returned: 0 in 5.354s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0bc07071-7626-495e-99f3-7f7fc17fc118 tempest-TestServerVolumeAttachScenarioOldVersion-1888088516 None] Lock "cinder-5db33482-6583-49a5-87ed-12dec170aa29-delete_volume" released by "delete_volume" :: held 4.373s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:41:36 devstack sudo[98484]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD
Sep 24 18:41:36 devstack sudo[98484]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:41:42 devstack sudo[98484]: pam_unix(sudo:session): session closed for user root
Sep 24 18:41:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD" returned: 1 in 7.167s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:41:42 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Temporary image dabd6069-2fcf-41d5-9811-492a6a9aad0f is fetched for user 533d238f3a23495690e5a8750e686bf5. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 18:41:42 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d962d2f3-ded7-438c-9608-6b46b23ffb04]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:41:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:43 devstack sudo[98530]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD
Sep 24 18:41:43 devstack sudo[98530]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:41:46 devstack sudo[98530]: pam_unix(sudo:session): session closed for user root
Sep 24 18:41:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD" returned: 0 in 3.803s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:47 devstack sudo[98535]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD
Sep 24 18:41:47 devstack sudo[98535]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:41:51 devstack sudo[98535]: pam_unix(sudo:session): session closed for user root
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD" returned: 1 in 4.390s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.008s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:41:28Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7c9ac25f-63b3-45c6-90e5-f2c751b5f5af,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='dba0ab1c7c114caf9abad6686c980b2e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:41:28Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:41:28Z,use_quota=True,user_id='533d238f3a23495690e5a8750e686bf5',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Creating volume 7c9ac25f-63b3-45c6-90e5-f2c751b5f5af {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:41:51 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:51 devstack quobyte-client[84204]: System call of process 98588 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:51 devstack quobyte-client[84204]: System call of process 98588 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:51 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=116, name=volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af 1073741824" returned: 0 in 0.591s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af" returned: 0 in 0.142s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] <== create_volume: return (896ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:41:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.947s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:41:52 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Attempting download of dabd6069-2fcf-41d5-9811-492a6a9aad0f ((None, [{'url': 'file:///opt/stack/data/glance/images/dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'metadata': {}}])) to volume 7c9ac25f-63b3-45c6-90e5-f2c751b5f5af. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1184}}
Sep 24 18:41:52 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[0a734669-320d-4abe-b196-f8b16a774f74]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:41:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dabd6069-2fcf-41d5-9811-492a6a9aad0f_f7kfnic7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_dabd6069-2fcf-41d5-9811-492a6a9aad0f_f7kfnic7" returned: 0 in 1.039s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dabd6069-2fcf-41d5-9811-492a6a9aad0f_f7kfnic7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dabd6069-2fcf-41d5-9811-492a6a9aad0f_f7kfnic7" returned: 1 in 0.724s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_dabd6069-2fcf-41d5-9811-492a6a9aad0f_f7kfnic7' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:41:54 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[4a92ce75-6109-46c1-b7ea-7d33980a491e]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:41:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD" returned: 0 in 0.764s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD" returned: 1 in 1.095s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:41:57 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] dabd6069-2fcf-41d5-9811-492a6a9aad0f was raw, converting to raw {{(pid=84177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 18:41:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:57 devstack quobyte-client[84204]: System call of process 98603 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:57 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=116, name=volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:41:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af" returned: 0 in 0.362s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:57 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_dabd6069-2fcf-41d5-9811-492a6a9aad0f_b1sqsapxdevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:41:57 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Converted 0.00 MB image at 0.00 MB/s
Sep 24 18:41:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:41:57 devstack quobyte-client[84204]: System call of process 98606 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:57 devstack quobyte-client[84204]: System call of process 98606 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:57 devstack quobyte-client[84204]: System call of process 98606 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:57 devstack quobyte-client[84204]: System call of process 98606 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:41:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af 1G" returned: 0 in 0.359s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:41:58 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a0a464b7-d2c9-4ed9-9667-2edc17e7ff1d]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:41:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af" returned: 0 in 1.601s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:00 devstack quobyte-client[84204]: System call of process 98616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:00 devstack quobyte-client[84204]: System call of process 98616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:01 devstack quobyte-client[84204]: System call of process 98616 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af" returned: 1 in 1.032s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:42:01 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Downloaded image dabd6069-2fcf-41d5-9811-492a6a9aad0f ((None, [{'url': 'file:///opt/stack/data/glance/images/dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'metadata': {}}])) to volume 7c9ac25f-63b3-45c6-90e5-f2c751b5f5af successfully. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1229}}
Sep 24 18:42:01 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Temporary image dabd6069-2fcf-41d5-9811-492a6a9aad0f for user 533d238f3a23495690e5a8750e686bf5 is deleted. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 18:42:01 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Marking volume 7c9ac25f-63b3-45c6-90e5-f2c751b5f5af as bootable. {{(pid=84177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1133}}
Sep 24 18:42:01 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Copying metadata from image dabd6069-2fcf-41d5-9811-492a6a9aad0f to 7c9ac25f-63b3-45c6-90e5-f2c751b5f5af. {{(pid=84177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 18:42:01 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Creating volume glance metadata for volume 7c9ac25f-63b3-45c6-90e5-f2c751b5f5af backed by image dabd6069-2fcf-41d5-9811-492a6a9aad0f with: {'image_id': 'dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'da806744bf8d922466c871e92320a94c', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 18:42:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f1c95512-b557-4af1-bce8-d89ec1d88a06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af', 'volume_size': 1, 'image_id': 'dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'da806744bf8d922466c871e92320a94c', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'dba0ab1c7c114caf9abad6686c980b2e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': '6d852c90e8519bf20eb8512708741d55dbc925320228514e4cf36414341a64d15f42dec5711eafba3e13672cf62f04a853931beb828915351832129955acab89', 'id': 'dabd6069-2fcf-41d5-9811-492a6a9aad0f', 'created_at': datetime.datetime(2025, 9, 24, 16, 41, 25, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 41, 26, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/dabd6069-2fcf-41d5-9811-492a6a9aad0f/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029d4b820>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c64604-fa6c-409f-8637-7c76a321fdff) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:01 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Volume volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af (7c9ac25f-63b3-45c6-90e5-f2c751b5f5af): created successfully
Sep 24 18:42:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4c64604-fa6c-409f-8637-7c76a321fdff) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Flow 'volume_create_manager' (2558499c-9f67-4eef-b8de-9d582cb32dfd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:42:01 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-20d160cf-9dd7-4c1d-862d-e318d1425230 tempest-VolumeImageDependencyTests-1192905775 None] Created volume successfully.
Sep 24 18:42:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Acquiring lock "cinder-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:42:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Lock "cinder-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:42:02 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:42:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Acquiring lock "cinder-quobyte-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:42:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Lock "cinder-quobyte-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af" acquired by "delete_volume" :: waited 0.017s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:42:02 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[976bf386-b8da-4932-8e46-3c9bbb5a7b07]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:42:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af" returned: 0 in 0.462s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:03 devstack quobyte-client[84204]: System call of process 98626 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:03 devstack quobyte-client[84204]: System call of process 98626 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:03 devstack quobyte-client[84204]: System call of process 98626 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af" returned: 1 in 0.606s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:42:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af" returned: 0 in 0.159s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Lock "cinder-quobyte-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af" released by "delete_volume" :: held 1.643s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:42:04 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Created reservations ['ed41acc4-0b8a-49f1-be4e-40262c3d48d7', '962533c8-ffd4-4604-b08c-dc2d4c4a567b', 'e45d5965-f3ca-4a40-85ce-979b1da32c61', '29d4829e-9ea2-42a1-b234-fbafc284420a'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:42:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:42:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:42:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:42:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:42:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:42:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.210s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:05 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:42:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Deleted volume successfully.
Sep 24 18:42:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-2d386f8f-a6c7-495e-a95e-307fd0d62a02 tempest-VolumeImageDependencyTests-1192905775 None] Lock "cinder-7c9ac25f-63b3-45c6-90e5-f2c751b5f5af-delete_volume" released by "delete_volume" :: held 3.173s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:42:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:42:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:42:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:42:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:42:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:42:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.033s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:42:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.154s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:42:15 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=23,cinder:UPDATE=22,cinder:INSERT=11,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:42:15 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=26,cinder:UPDATE=25,cinder:DELETE=3,cinder:INSERT=6 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:42:44 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:42:44 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Flow 'volume_create_manager' (67f7100f-9fa1-4a6d-8fc4-3acb21b662fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e564832-da2a-4fd7-a26b-bc4146a83845) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3e564832-da2a-4fd7-a26b-bc4146a83845) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-101124941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cf2939-72db-4c92-881d-b20e9bdd8f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aadd5af98a44398a0962cbe54c1752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:42:44Z,use_quota=True,user_id='fd1093a703f3446ea6671a6e46a595fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58709259-c28f-490d-9088-b4b107fc756e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (58709259-c28f-490d-9088-b4b107fc756e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be23bbf5-0cef-4d65-a704-e43e4d25b3af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (be23bbf5-0cef-4d65-a704-e43e4d25b3af) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '42cf2939-72db-4c92-881d-b20e9bdd8f8d', 'volume_name': 'volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a253288-a251-438d-99da-87449b125cb8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a253288-a251-438d-99da-87449b125cb8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a072dc0-7031-445b-937c-8055eb9055d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:45 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Volume 42cf2939-72db-4c92-881d-b20e9bdd8f8d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d', 'volume_size': 1}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:42:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-101124941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=42cf2939-72db-4c92-881d-b20e9bdd8f8d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aadd5af98a44398a0962cbe54c1752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:42:44Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:42:44Z,use_quota=True,user_id='fd1093a703f3446ea6671a6e46a595fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Creating volume 42cf2939-72db-4c92-881d-b20e9bdd8f8d {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.051s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:42:45 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:42:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:46 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=117, name=volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:42:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d 1073741824" returned: 0 in 1.032s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d" returned: 0 in 0.368s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] <== create_volume: return (1600ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:42:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.642s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:42:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (4a072dc0-7031-445b-937c-8055eb9055d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d08dca-74e6-414b-8a36-a91fd13decf7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:47 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Volume volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d (42cf2939-72db-4c92-881d-b20e9bdd8f8d): created successfully
Sep 24 18:42:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (99d08dca-74e6-414b-8a36-a91fd13decf7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Flow 'volume_create_manager' (67f7100f-9fa1-4a6d-8fc4-3acb21b662fb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:42:48 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a555c12d-0b96-424f-b89e-b65f07ccaa74 tempest-SnapshotDependencyTests-591001985 None] Created volume successfully.
Sep 24 18:42:49 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:42:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:42:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:42:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Creating offline snapshot 4550e380-24b3-4a08-8bfd-c85e70d66ecd of volume 42cf2939-72db-4c92-881d-b20e9bdd8f8d {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:42:50 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[87ce147e-3992-4803-aee2-0fe4effa7d10]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:42:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:51 devstack quobyte-client[84204]: System call of process 98823 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:51 devstack quobyte-client[84204]: System call of process 98823 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:51 devstack quobyte-client[84204]: System call of process 98823 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d" returned: 0 in 0.917s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:51 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=118, name=volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:42:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd 1G" returned: 0 in 0.512s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): qemu-img rebase -u -b volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:52 devstack quobyte-client[84204]: System call of process 98831 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:52 devstack quobyte-client[84204]: System call of process 98831 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:52 devstack quobyte-client[84204]: System call of process 98831 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:52 devstack quobyte-client[84204]: System call of process 98831 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:52 devstack quobyte-client[84204]: System call of process 98831 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] CMD "qemu-img rebase -u -b volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd" returned: 0 in 0.611s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:42:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd" returned: 0 in 0.171s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:42:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:52 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:42:52 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Flow 'volume_create_manager' (24fff3d2-c680-432a-882e-5e8e09f74ee2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd4d3c1-afbd-4201-8b6b-f2e8b9fab4a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ffd4d3c1-afbd-4201-8b6b-f2e8b9fab4a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1295409567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f666b1-32d2-457e-9bc4-ef4d6d2162b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b0774349f248968aa16300c99e3664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:42:52Z,use_quota=True,user_id='cb6d69e7e72a44ca82b7d0dca718c47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c95318-8c90-4f5e-b2e3-f43e7b5e8b7c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (77c95318-8c90-4f5e-b2e3-f43e7b5e8b7c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b83eb5-9eeb-4b59-81dc-4a8d700b2b1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d2b83eb5-9eeb-4b59-81dc-4a8d700b2b1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '35f666b1-32d2-457e-9bc4-ef4d6d2162b2', 'volume_name': 'volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac34817-26e3-45c1-893c-5fd785388c97) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (2ac34817-26e3-45c1-893c-5fd785388c97) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5af1765-8baf-4529-a133-3749babbd8d8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:53 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume 35f666b1-32d2-457e-9bc4-ef4d6d2162b2: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2', 'volume_size': 1}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd" returned: 0 in 1.020s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:42:53 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Flow 'volume_create_manager' (c8d235dc-5eb0-437c-9808-780263aebf29) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422b1872-bfd5-4b7c-918b-e9c25532bdf2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.info" returned: 0 in 0.858s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (422b1872-bfd5-4b7c-918b-e9c25532bdf2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1281274836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc236da-d809-4d06-a8ec-907f95dfa569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b0774349f248968aa16300c99e3664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:42:53Z,use_quota=True,user_id='cb6d69e7e72a44ca82b7d0dca718c47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a821ef-02f0-4a64-8eed-e2c935c07cad) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f0a821ef-02f0-4a64-8eed-e2c935c07cad) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92a95ce-0992-4ff8-899b-4c7ac3c71668) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d92a95ce-0992-4ff8-899b-4c7ac3c71668) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '9fc236da-d809-4d06-a8ec-907f95dfa569', 'volume_name': 'volume-9fc236da-d809-4d06-a8ec-907f95dfa569', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0e4290-b2b2-4327-ba8b-14e4c803b522) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (0e0e4290-b2b2-4327-ba8b-14e4c803b522) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff31635-9b24-4113-a3ee-0079d156d76a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:54 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume 9fc236da-d809-4d06-a8ec-907f95dfa569: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-9fc236da-d809-4d06-a8ec-907f95dfa569', 'volume_size': 1}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.info" returned: 0 in 0.335s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 4.902s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.409s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1295409567',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=35f666b1-32d2-457e-9bc4-ef4d6d2162b2,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b0774349f248968aa16300c99e3664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:42:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:42:52Z,use_quota=True,user_id='cb6d69e7e72a44ca82b7d0dca718c47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Creating volume 35f666b1-32d2-457e-9bc4-ef4d6d2162b2 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.045s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:42:55 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:55 devstack quobyte-client[84204]: System call of process 98839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:55 devstack quobyte-client[84204]: System call of process 98839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:55 devstack quobyte-client[84204]: System call of process 98839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:55 devstack quobyte-client[84204]: System call of process 98839 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:55 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=120, name=volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:42:55 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-6a0a1b7e-968b-40b2-b887-9a143ba90018 tempest-SnapshotDependencyTests-591001985 None] Create snapshot completed successfully
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2 1073741824" returned: 0 in 0.551s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2" returned: 0 in 0.124s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] <== create_volume: return (774ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.796s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.131s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:42:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-TestServerVolumeAttachmentScenario-volume-1281274836',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=9fc236da-d809-4d06-a8ec-907f95dfa569,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='30b0774349f248968aa16300c99e3664',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:42:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:42:53Z,use_quota=True,user_id='cb6d69e7e72a44ca82b7d0dca718c47e',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Creating volume 9fc236da-d809-4d06-a8ec-907f95dfa569 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:42:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:42:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:42:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:42:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:42:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:42:56 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:42:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9fc236da-d809-4d06-a8ec-907f95dfa569 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:56 devstack quobyte-client[84204]: System call of process 98843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:56 devstack quobyte-client[84204]: System call of process 98843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:56 devstack quobyte-client[84204]: System call of process 98843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:56 devstack quobyte-client[84204]: System call of process 98843 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:56 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=121, name=volume-9fc236da-d809-4d06-a8ec-907f95dfa569, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:42:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5af1765-8baf-4529-a133-3749babbd8d8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972eb0b1-9469-4f86-a2a0-5f9ba467fc4a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:56 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2 (35f666b1-32d2-457e-9bc4-ef4d6d2162b2): created successfully
Sep 24 18:42:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (972eb0b1-9469-4f86-a2a0-5f9ba467fc4a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Flow 'volume_create_manager' (24fff3d2-c680-432a-882e-5e8e09f74ee2) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:42:56 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-38db887b-e851-49aa-b343-b365977c5f3f tempest-TestServerVolumeAttachmentScenario-1091402776 None] Created volume successfully.
Sep 24 18:42:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9fc236da-d809-4d06-a8ec-907f95dfa569 1073741824" returned: 0 in 0.790s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9fc236da-d809-4d06-a8ec-907f95dfa569 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9fc236da-d809-4d06-a8ec-907f95dfa569" returned: 0 in 0.216s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] <== create_volume: return (1073ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.101s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (fff31635-9b24-4113-a3ee-0079d156d76a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-9fc236da-d809-4d06-a8ec-907f95dfa569', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b71605c-3d4d-424a-8889-dbb8ab62509c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:57 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume volume-9fc236da-d809-4d06-a8ec-907f95dfa569 (9fc236da-d809-4d06-a8ec-907f95dfa569): created successfully
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7b71605c-3d4d-424a-8889-dbb8ab62509c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Flow 'volume_create_manager' (c8d235dc-5eb0-437c-9808-780263aebf29) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:42:57 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-36b9a913-109e-459b-88a7-8cfa18aeb47a tempest-TestServerVolumeAttachmentScenario-1091402776 None] Created volume successfully.
Sep 24 18:42:57 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Flow 'volume_create_manager' (9333733f-9b25-4e35-999b-e5beb3b285b5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2b4527-b345-4901-9050-c9a4f74644fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0b2b4527-b345-4901-9050-c9a4f74644fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:42:57Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e3aadd5af98a44398a0962cbe54c1752',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:42:58Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=4550e380-24b3-4a08-8bfd-c85e70d66ecd,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:42:58Z,use_quota=True,user_id='fd1093a703f3446ea6671a6e46a595fb',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51527600-cb68-41f6-b5e9-f819d7115f40) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (51527600-cb68-41f6-b5e9-f819d7115f40) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9483895-2173-49a0-a884-0370473598be) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e9483895-2173-49a0-a884-0370473598be) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': '4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862', 'volume_name': 'volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862', 'volume_size': 1, 'snapshot_id': '4550e380-24b3-4a08-8bfd-c85e70d66ecd'}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe66b46c-1ddd-4726-b0c7-9488a65d4b3f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (fe66b46c-1ddd-4726-b0c7-9488a65d4b3f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9571df5e-740a-4ff8-8520-227795e5aefe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:42:57 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Volume 4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862', 'volume_size': 1, 'snapshot_id': '4550e380-24b3-4a08-8bfd-c85e70d66ecd'}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "cinder-quobyte-4550e380-24b3-4a08-8bfd-c85e70d66ecd-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" by "_create_volume_from_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-quobyte-4550e380-24b3-4a08-8bfd-c85e70d66ecd-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" acquired by "_create_volume_from_snapshot" :: waited 0.016s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Creating volume 4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862 from snapshot 4550e380-24b3-4a08-8bfd-c85e70d66ecd {{(pid=84177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:42:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "cinder-quobyte-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" by "_copy_volume_from_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-quobyte-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] snapshot: 4550e380-24b3-4a08-8bfd-c85e70d66ecd, volume: 4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862,  {{(pid=84177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c1cdfc99-071b-40d2-bcf8-0b18b3ae87ae]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:58 devstack quobyte-client[84204]: System call of process 98848 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd" returned: 0 in 0.741s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d {{(pid=84177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Creating direct copy from snapshot {{(pid=84177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[603ee091-8b57-4607-a3c5-7fb5a31c01ae]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:42:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:42:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d" returned: 0 in 0.709s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:42:59 devstack cinder-volume[84177]: DEBUG cinder.utils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862 not found in is_blk_device check {{(pid=84177) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 24 18:42:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:00 devstack quobyte-client[84204]: System call of process 98855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:43:00 devstack quobyte-client[84204]: System call of process 98855 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:43:00 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=122, name=volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:43:08 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=6,cinder:UPDATE=8,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:43:08 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=7,cinder:UPDATE=7,cinder:DELETE=3 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:43:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" returned: 0 in 10.212s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:10 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[08775237-be9b-4f7a-a7a4-cf9721888c1a]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:43:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:10 devstack quobyte-client[84204]: System call of process 98911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:43:10 devstack quobyte-client[84204]: System call of process 98911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:43:10 devstack quobyte-client[84204]: System call of process 98911 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:43:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d" returned: 0 in 1.451s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:11 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d, size 1024.00 MB, duration 10.22 sec, destination /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862 {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:43:11 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Converted 1024.00 MB image at 100.19 MB/s
Sep 24 18:43:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:43:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" returned: 0 in 0.182s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-quobyte-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" released by "_copy_volume_from_snapshot" :: held 13.956s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:43:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-quobyte-4550e380-24b3-4a08-8bfd-c85e70d66ecd-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" released by "_create_volume_from_snapshot" :: held 14.038s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:43:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 14.070s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:43:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:43:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:43:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:43:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:43:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:43:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:43:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9571df5e-740a-4ff8-8520-227795e5aefe) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862', 'volume_size': 1, 'snapshot_id': '4550e380-24b3-4a08-8bfd-c85e70d66ecd'}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:43:13 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f15c49e-c7b2-472f-a796-d9c74f44a8c0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:43:14 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Volume volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862 (4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862): created successfully
Sep 24 18:43:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9f15c49e-c7b2-472f-a796-d9c74f44a8c0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:43:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Flow 'volume_create_manager' (9333733f-9b25-4e35-999b-e5beb3b285b5) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:43:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 1.669s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:14 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:43:14 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-eea7e764-3b83-4a71-ad72-29c9cef25832 tempest-SnapshotDependencyTests-591001985 None] Created volume successfully.
Sep 24 18:43:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "cinder-4550e380-24b3-4a08-8bfd-c85e70d66ecd-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:43:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-4550e380-24b3-4a08-8bfd-c85e70d66ecd-delete_snapshot" acquired by "delete_snapshot" :: waited 0.099s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:43:15 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:43:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "cinder-quobyte-42cf2939-72db-4c92-881d-b20e9bdd8f8d" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:43:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-quobyte-42cf2939-72db-4c92-881d-b20e9bdd8f8d" acquired by "delete_snapshot" :: waited 0.080s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:43:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "cinder-quobyte-4550e380-24b3-4a08-8bfd-c85e70d66ecd" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:43:15 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-quobyte-4550e380-24b3-4a08-8bfd-c85e70d66ecd" acquired by "_delete_snapshot" :: waited 0.035s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:43:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Deleting offline snapshot 4550e380-24b3-4a08-8bfd-c85e70d66ecd of volume 42cf2939-72db-4c92-881d-b20e9bdd8f8d {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:43:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] snapshot_file for this snap is: volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:43:15 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[645b48d7-7158-42af-84e9-3d815768361c]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:43:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:16 devstack quobyte-client[84204]: System call of process 98929 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:43:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd" returned: 0 in 1.389s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:17 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:43:17 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[abb1ce89-b5ae-4ce6-97e9-16d8f9fa12ce]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:43:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d" returned: 0 in 0.532s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd" returned: 0 in 0.247s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d.4550e380-24b3-4a08-8bfd-c85e70d66ecd" returned: 0 in 0.144s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-quobyte-4550e380-24b3-4a08-8bfd-c85e70d66ecd" released by "_delete_snapshot" :: held 2.971s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:43:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-quobyte-42cf2939-72db-4c92-881d-b20e9bdd8f8d" released by "delete_snapshot" :: held 3.025s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:43:18 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Created reservations ['e9ea5103-59cf-4086-98d8-a1ad0dc602af', '90951efd-e84e-4714-9c5a-91779a6cd4e4', '906d7541-804a-4d49-ab89-71fdb68167a4', '56fc5c50-57b5-498d-b8ec-22c2841c3c5b'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:43:18 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Delete snapshot completed successfully.
Sep 24 18:43:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ff3c87a0-c9ba-495c-a529-c296b9dccf36 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-4550e380-24b3-4a08-8bfd-c85e70d66ecd-delete_snapshot" released by "delete_snapshot" :: held 3.709s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:43:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "cinder-42cf2939-72db-4c92-881d-b20e9bdd8f8d-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:43:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-42cf2939-72db-4c92-881d-b20e9bdd8f8d-delete_volume" acquired by "delete_volume" :: waited 0.071s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:43:20 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:43:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "cinder-quobyte-42cf2939-72db-4c92-881d-b20e9bdd8f8d" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:43:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-quobyte-42cf2939-72db-4c92-881d-b20e9bdd8f8d" acquired by "delete_volume" :: waited 0.033s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:43:20 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[02c1ae4f-0aaa-4de4-9ad7-122118f9f71b]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:43:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:20 devstack quobyte-client[84204]: System call of process 98960 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:43:20 devstack quobyte-client[84204]: System call of process 98960 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:43:20 devstack quobyte-client[84204]: System call of process 98960 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:43:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d" returned: 0 in 0.516s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-42cf2939-72db-4c92-881d-b20e9bdd8f8d" returned: 0 in 0.182s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-quobyte-42cf2939-72db-4c92-881d-b20e9bdd8f8d" released by "delete_volume" :: held 1.020s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:43:21 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Created reservations ['00d0830f-a232-4d66-94e3-8946809b6af4', 'b729fc1a-5292-460b-aeb9-7910018ca03f', '2694cc65-9298-461a-9a18-b022b80d01d2', '7c9ad719-3ae6-4a0e-9494-badfbf0011ee'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:43:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:43:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:43:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:43:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:43:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:43:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.111s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:21 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:43:21 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Deleted volume successfully.
Sep 24 18:43:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1bf3bce1-85c0-4825-87b0-37b3b08d1506 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-42cf2939-72db-4c92-881d-b20e9bdd8f8d-delete_volume" released by "delete_volume" :: held 2.234s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:43:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "cinder-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:43:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862-delete_volume" acquired by "delete_volume" :: waited 0.051s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:43:22 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:43:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "cinder-quobyte-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:43:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-quobyte-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" acquired by "delete_volume" :: waited 0.011s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:43:22 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[874c0d25-988c-4af1-85f3-03f89c8d5618]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:43:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" returned: 0 in 0.464s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" returned: 0 in 0.119s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-quobyte-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862" released by "delete_volume" :: held 0.910s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:43:23 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Created reservations ['9e56583d-9b06-4e25-82d4-9958c2e1d255', 'd98537ff-f3c6-4a8c-a010-879a91b1aadb', '86209b82-737a-49cc-a4ba-e050b90dea5b', 'c927be06-9e75-4b35-88ad-a1650b4cba9c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:43:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:43:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:43:23 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:43:23 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:43:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.034s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:43:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:43:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.144s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:43:24 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:43:24 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Deleted volume successfully.
Sep 24 18:43:24 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-f326252f-4a9f-4435-afe6-8c909caef711 tempest-SnapshotDependencyTests-591001985 None] Lock "cinder-4682ccd6-dc2f-4e10-8ce1-a7f8caaaa862-delete_volume" released by "delete_volume" :: held 2.332s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:43:33 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=13,cinder:UPDATE=10,cinder:DELETE=1,cinder:INSERT=7 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:43:34 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=36,cinder:SELECT=17,cinder:INSERT=5,cinder:DELETE=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:43:46 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:43:47 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:44:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:44:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:44:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:44:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.079s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:44:19 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-b867831f-9f96-40f7-af05-b1660cf77b2f req-4b3f3f88-1cce-4148-9db3-d22813e56abe tempest-TestMinimumBasicScenario-1140205600 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:44:19 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-b867831f-9f96-40f7-af05-b1660cf77b2f req-4b3f3f88-1cce-4148-9db3-d22813e56abe tempest-TestMinimumBasicScenario-1140205600 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:44:19 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-b867831f-9f96-40f7-af05-b1660cf77b2f req-4b3f3f88-1cce-4148-9db3-d22813e56abe tempest-TestMinimumBasicScenario-1140205600 None] Terminate volume connection completed successfully.
Sep 24 18:44:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-b867831f-9f96-40f7-af05-b1660cf77b2f req-4b3f3f88-1cce-4148-9db3-d22813e56abe tempest-TestMinimumBasicScenario-1140205600 None] Deleting attachment 10534d6d-48bd-43c8-9e02-70347a6b58a8. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:44:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Acquiring lock "cinder-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:44:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Lock "cinder-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb-delete_volume" acquired by "delete_volume" :: waited 0.055s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:44:21 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:44:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Acquiring lock "cinder-quobyte-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:44:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Lock "cinder-quobyte-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb" acquired by "delete_volume" :: waited 0.017s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:44:21 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[09725d9f-a926-49b0-9127-71c012b349c2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:44:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:21 devstack quobyte-client[84204]: System call of process 99196 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:21 devstack quobyte-client[84204]: System call of process 99196 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:21 devstack quobyte-client[84204]: System call of process 99196 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:21 devstack quobyte-client[84204]: System call of process 99196 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb" returned: 0 in 0.461s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb" returned: 0 in 0.088s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Lock "cinder-quobyte-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb" released by "delete_volume" :: held 0.735s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:44:22 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Created reservations ['1ec802e0-c5e9-4aa3-90e4-91ed54e4f891', '0bf6217b-7274-4895-be0d-71ac92ddc56b', 'c5cc2a9c-ea3c-41f6-8009-33699650b249', '6a3231ee-bdfc-4069-93b0-046f0fee1748'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:44:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:44:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:44:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.017s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.089s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:22 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:44:22 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Deleted volume successfully.
Sep 24 18:44:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1c37d4c7-b456-4a50-a5ce-327ddce0ced0 tempest-TestMinimumBasicScenario-1140205600 None] Lock "cinder-4b32a1ea-50af-4994-8f16-d8e6ec79b2bb-delete_volume" released by "delete_volume" :: held 1.622s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:44:32 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=6,cinder:UPDATE=10 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:44:32 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=6,cinder:UPDATE=6,cinder:INSERT=4,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:44:45 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Flow 'volume_create_manager' (1740e783-133e-43c1-bf95-54379ea7b72e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97cfbefb-4814-4038-9653-c0260d6f87a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (97cfbefb-4814-4038-9653-c0260d6f87a4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1055774132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f255c7b-6419-4921-9531-3b07966dea21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107ee7e1f604191a1e30acd39d7ce53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:44:45Z,use_quota=True,user_id='db2f845fdd374479ae6ae4653fff6aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8ce40f-8237-41d6-b21d-7b64968ed16c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1f8ce40f-8237-41d6-b21d-7b64968ed16c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004c5fff-91d8-4598-9015-d9ff8be5fd0a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (004c5fff-91d8-4598-9015-d9ff8be5fd0a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f255c7b-6419-4921-9531-3b07966dea21', 'volume_name': 'volume-6f255c7b-6419-4921-9531-3b07966dea21', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6e52d8-fc90-4d11-a875-8622cd14b39f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1c6e52d8-fc90-4d11-a875-8622cd14b39f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e097e9fe-7d67-4f30-aecb-b1bc23f399e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:45 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume 6f255c7b-6419-4921-9531-3b07966dea21: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f255c7b-6419-4921-9531-3b07966dea21', 'volume_size': 1}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:44:45Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1055774132',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f255c7b-6419-4921-9531-3b07966dea21,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107ee7e1f604191a1e30acd39d7ce53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:44:45Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:44:45Z,use_quota=True,user_id='db2f845fdd374479ae6ae4653fff6aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Creating volume 6f255c7b-6419-4921-9531-3b07966dea21 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:44:45 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:44:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:46 devstack quobyte-client[84204]: System call of process 99264 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:46 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=123, name=volume-6f255c7b-6419-4921-9531-3b07966dea21, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:44:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21 1073741824" returned: 0 in 0.648s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-a37cfe2d-2192-4775-9910-6b02a93d9541 req-e83624a7-3ae4-451c-84eb-00a8c60400aa tempest-TestServerVolumeAttachmentScenario-1091402776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21" returned: 0 in 0.232s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] <== create_volume: return (914ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:44:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.931s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-a37cfe2d-2192-4775-9910-6b02a93d9541 req-e83624a7-3ae4-451c-84eb-00a8c60400aa tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.060s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:46 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ec67576e-4367-404d-9af0-553c77fe8eb4]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:44:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-a37cfe2d-2192-4775-9910-6b02a93d9541 req-e83624a7-3ae4-451c-84eb-00a8c60400aa tempest-TestServerVolumeAttachmentScenario-1091402776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (e097e9fe-7d67-4f30-aecb-b1bc23f399e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f255c7b-6419-4921-9531-3b07966dea21', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83da2c02-dc2a-447f-89fc-e85eb0209941) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:47 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume volume-6f255c7b-6419-4921-9531-3b07966dea21 (6f255c7b-6419-4921-9531-3b07966dea21): created successfully
Sep 24 18:44:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (83da2c02-dc2a-447f-89fc-e85eb0209941) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Flow 'volume_create_manager' (1740e783-133e-43c1-bf95-54379ea7b72e) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:44:47 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-46f33fcb-bcc8-4730-8fde-636a615f31f1 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created volume successfully.
Sep 24 18:44:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-a37cfe2d-2192-4775-9910-6b02a93d9541 req-e83624a7-3ae4-451c-84eb-00a8c60400aa tempest-TestServerVolumeAttachmentScenario-1091402776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2" returned: 0 in 0.500s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-a37cfe2d-2192-4775-9910-6b02a93d9541 req-e83624a7-3ae4-451c-84eb-00a8c60400aa tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 0.547s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-a37cfe2d-2192-4775-9910-6b02a93d9541 req-e83624a7-3ae4-451c-84eb-00a8c60400aa tempest-TestServerVolumeAttachmentScenario-1091402776 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': '87a2a7b4-1086-4b92-a69b-3dca143a19b5', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:44:47 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-a37cfe2d-2192-4775-9910-6b02a93d9541 req-e83624a7-3ae4-451c-84eb-00a8c60400aa tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:44:47 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-a37cfe2d-2192-4775-9910-6b02a93d9541 req-e83624a7-3ae4-451c-84eb-00a8c60400aa tempest-TestServerVolumeAttachmentScenario-1091402776 None] attachment_update completed successfully.
Sep 24 18:44:47 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:44:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Creating offline snapshot 298fe433-cab8-4dbb-a30e-d4d898b96bb7 of volume 6f255c7b-6419-4921-9531-3b07966dea21 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:44:47 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[cb6c97bc-9adb-4244-809d-38cc5ad4c5e5]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:44:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:48 devstack quobyte-client[84204]: System call of process 99271 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21" returned: 0 in 0.500s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:48 devstack quobyte-client[84204]: System call of process 99320 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:48 devstack quobyte-client[84204]: System call of process 99320 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:48 devstack quobyte-client[84204]: System call of process 99320 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:48 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=124, name=volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:44:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7 1G" returned: 0 in 0.340s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): qemu-img rebase -u -b volume-6f255c7b-6419-4921-9531-3b07966dea21 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "qemu-img rebase -u -b volume-6f255c7b-6419-4921-9531-3b07966dea21 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7" returned: 0 in 0.165s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:44:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7" returned: 0 in 0.117s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:44:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7" returned: 0 in 0.112s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.info" returned: 0 in 0.137s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:44:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.info" returned: 0 in 0.099s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.803s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:49 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-20d8ab67-84be-4bdd-a5ce-4f8983b1db1a tempest-CreateVolumesFromSnapshotTest-1221444267 None] Create snapshot completed successfully
Sep 24 18:44:51 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Flow 'volume_create_manager' (1a71cf2d-08c0-4712-96c4-96a15bcf764b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408174da-e11a-436b-a3d7-02a9d872879a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (408174da-e11a-436b-a3d7-02a9d872879a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1314192200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0844c32-4bd1-4e82-8e97-75681795119f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107ee7e1f604191a1e30acd39d7ce53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:44:51Z,use_quota=True,user_id='db2f845fdd374479ae6ae4653fff6aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19650e6f-d6b0-4062-9eb4-3b513cbcf8b2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (19650e6f-d6b0-4062-9eb4-3b513cbcf8b2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba29e1f4-e452-4712-bf1d-70b37be994f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ba29e1f4-e452-4712-bf1d-70b37be994f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e0844c32-4bd1-4e82-8e97-75681795119f', 'volume_name': 'volume-e0844c32-4bd1-4e82-8e97-75681795119f', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957cffb6-d678-477c-9add-2b66eb7b082f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (957cffb6-d678-477c-9add-2b66eb7b082f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0598d9fc-1a32-4169-aedf-28fac20b351f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:51 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume e0844c32-4bd1-4e82-8e97-75681795119f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e0844c32-4bd1-4e82-8e97-75681795119f', 'volume_size': 1}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1314192200',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e0844c32-4bd1-4e82-8e97-75681795119f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107ee7e1f604191a1e30acd39d7ce53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:44:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:44:51Z,use_quota=True,user_id='db2f845fdd374479ae6ae4653fff6aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Creating volume e0844c32-4bd1-4e82-8e97-75681795119f {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:44:51 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:44:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e0844c32-4bd1-4e82-8e97-75681795119f 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:51 devstack quobyte-client[84204]: System call of process 99672 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:51 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=126, name=volume-e0844c32-4bd1-4e82-8e97-75681795119f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e0844c32-4bd1-4e82-8e97-75681795119f 1073741824" returned: 0 in 0.506s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e0844c32-4bd1-4e82-8e97-75681795119f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:52 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Flow 'volume_create_manager' (ab24d43b-7415-4a93-9a96-347ac2687942) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2323fcc-52d4-419c-b7d8-58b784d8e81d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e0844c32-4bd1-4e82-8e97-75681795119f" returned: 0 in 0.572s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] <== create_volume: return (1116ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.129s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b2323fcc-52d4-419c-b7d8-58b784d8e81d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-942361241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e119a5f9-da29-49c7-8503-7fcc90c22971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107ee7e1f604191a1e30acd39d7ce53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:44:52Z,use_quota=True,user_id='db2f845fdd374479ae6ae4653fff6aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bc6025-563a-4670-b273-9be39e9ccac3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (e9bc6025-563a-4670-b273-9be39e9ccac3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea05989-3f84-4b3b-bc4d-034b1d111b1f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1ea05989-3f84-4b3b-bc4d-034b1d111b1f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e119a5f9-da29-49c7-8503-7fcc90c22971', 'volume_name': 'volume-e119a5f9-da29-49c7-8503-7fcc90c22971', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bfd3ba-a51f-4c7e-8815-0c57c385d79f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (66bfd3ba-a51f-4c7e-8815-0c57c385d79f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15c8289-09ea-4ff7-84ff-7940712068c5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:52 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume e119a5f9-da29-49c7-8503-7fcc90c22971: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e119a5f9-da29-49c7-8503-7fcc90c22971', 'volume_size': 1}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:44:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-942361241',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e119a5f9-da29-49c7-8503-7fcc90c22971,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107ee7e1f604191a1e30acd39d7ce53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:44:52Z,use_quota=True,user_id='db2f845fdd374479ae6ae4653fff6aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Creating volume e119a5f9-da29-49c7-8503-7fcc90c22971 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:44:52 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:44:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e119a5f9-da29-49c7-8503-7fcc90c22971 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:53 devstack quobyte-client[84204]: System call of process 99676 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:53 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=127, name=volume-e119a5f9-da29-49c7-8503-7fcc90c22971, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:44:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Flow 'volume_create_manager' (7bc546e5-bf54-48f2-ad11-2b9af18efa59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b7e48a-3884-4895-9d3c-48db17ce5ffc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Flow 'volume_create_manager' (256f96b0-3cb1-4990-bf5a-759885374420) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57203942-e5e6-4a69-ac3b-a1f7ab01f792) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0598d9fc-1a32-4169-aedf-28fac20b351f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e0844c32-4bd1-4e82-8e97-75681795119f', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc57472-3e93-489a-92cf-77f0d14016cc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e119a5f9-da29-49c7-8503-7fcc90c22971 1073741824" returned: 0 in 0.661s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (c3b7e48a-3884-4895-9d3c-48db17ce5ffc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-844047689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02ab18a-eb17-428e-9ad4-1a7378e8fbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107ee7e1f604191a1e30acd39d7ce53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:44:52Z,use_quota=True,user_id='db2f845fdd374479ae6ae4653fff6aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70d5e18-7bc7-4ae2-aeec-35b9ce27f4d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b70d5e18-7bc7-4ae2-aeec-35b9ce27f4d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdb2af1-d1cc-43a8-831f-301f7cc091a5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9fdb2af1-d1cc-43a8-831f-301f7cc091a5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e02ab18a-eb17-428e-9ad4-1a7378e8fbda', 'volume_name': 'volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde7fce3-3057-43ac-9fdf-587ad5e6371b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (cde7fce3-3057-43ac-9fdf-587ad5e6371b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2382c7-fa73-46c7-ae05-1f0f08caa2df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:53 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume e02ab18a-eb17-428e-9ad4-1a7378e8fbda: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda', 'volume_size': 1}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e119a5f9-da29-49c7-8503-7fcc90c22971 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (57203942-e5e6-4a69-ac3b-a1f7ab01f792) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-211067774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a94da4-d1fb-4fc6-bbe7-6d607cfac98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107ee7e1f604191a1e30acd39d7ce53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:44:53Z,use_quota=True,user_id='db2f845fdd374479ae6ae4653fff6aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbee7b5-275c-4094-a107-a5cf8b2b2360) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7cbee7b5-275c-4094-a107-a5cf8b2b2360) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ff52ae-bc0c-41aa-9a30-2c2af81a7ab2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d5ff52ae-bc0c-41aa-9a30-2c2af81a7ab2) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '57a94da4-d1fb-4fc6-bbe7-6d607cfac98a', 'volume_name': 'volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5377781a-2c42-4eab-9c8c-82d83c185570) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5377781a-2c42-4eab-9c8c-82d83c185570) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90faae4-2b7c-41e2-9d20-66d52f894b5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:53 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume 57a94da4-d1fb-4fc6-bbe7-6d607cfac98a: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a', 'volume_size': 1}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:53 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume volume-e0844c32-4bd1-4e82-8e97-75681795119f (e0844c32-4bd1-4e82-8e97-75681795119f): created successfully
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (dcc57472-3e93-489a-92cf-77f0d14016cc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Flow 'volume_create_manager' (1a71cf2d-08c0-4712-96c4-96a15bcf764b) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:44:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Flow 'volume_create_manager' (9882e53d-d491-4f7c-90a2-c836ffb49a12) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9562c263-b7a1-48ce-a4a8-3f2f761f0bdf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e119a5f9-da29-49c7-8503-7fcc90c22971" returned: 0 in 0.565s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] <== create_volume: return (1287ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.294s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.618s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-844047689',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e02ab18a-eb17-428e-9ad4-1a7378e8fbda,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107ee7e1f604191a1e30acd39d7ce53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:44:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:44:52Z,use_quota=True,user_id='db2f845fdd374479ae6ae4653fff6aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Creating volume e02ab18a-eb17-428e-9ad4-1a7378e8fbda {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:44:54 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:54 devstack quobyte-client[84204]: System call of process 99680 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:54 devstack quobyte-client[84204]: System call of process 99680 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:54 devstack quobyte-client[84204]: System call of process 99680 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:54 devstack quobyte-client[84204]: System call of process 99680 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:54 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=128, name=volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9562c263-b7a1-48ce-a4a8-3f2f761f0bdf) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1093252854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ed702b-d31f-478d-b385-fc0e7a6c632b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107ee7e1f604191a1e30acd39d7ce53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:44:53Z,use_quota=True,user_id='db2f845fdd374479ae6ae4653fff6aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d92a85-4d91-4da7-a244-394056417ed2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (15d92a85-4d91-4da7-a244-394056417ed2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f00e76-95d3-4da5-baf1-bd577f3111c7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (22f00e76-95d3-4da5-baf1-bd577f3111c7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6ed702b-d31f-478d-b385-fc0e7a6c632b', 'volume_name': 'volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8d828d-d6fe-4999-bf88-440623c4263d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (5f8d828d-d6fe-4999-bf88-440623c4263d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61b705e-9da5-43bc-a492-5690914f7b20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:54 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume a6ed702b-d31f-478d-b385-fc0e7a6c632b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b', 'volume_size': 1}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:54 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-94209db0-d42c-4cab-849b-5130a14a4975 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created volume successfully.
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c15c8289-09ea-4ff7-84ff-7940712068c5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e119a5f9-da29-49c7-8503-7fcc90c22971', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ed7700-764f-427b-b5f3-b0401c205c06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda 1073741824" returned: 0 in 0.553s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:54 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume volume-e119a5f9-da29-49c7-8503-7fcc90c22971 (e119a5f9-da29-49c7-8503-7fcc90c22971): created successfully
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d4ed7700-764f-427b-b5f3-b0401c205c06) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Flow 'volume_create_manager' (ab24d43b-7415-4a93-9a96-347ac2687942) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda" returned: 0 in 0.347s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] <== create_volume: return (933ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.944s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.259s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:44:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-211067774',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=57a94da4-d1fb-4fc6-bbe7-6d607cfac98a,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107ee7e1f604191a1e30acd39d7ce53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:44:53Z,use_quota=True,user_id='db2f845fdd374479ae6ae4653fff6aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Creating volume 57a94da4-d1fb-4fc6-bbe7-6d607cfac98a {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:44:55 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:55 devstack quobyte-client[84204]: System call of process 99684 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:55 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-494a158a-4ed9-42b8-8340-dd4b62d7a763 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created volume successfully.
Sep 24 18:44:55 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=129, name=volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ae2382c7-fa73-46c7-ae05-1f0f08caa2df) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e947a9f-a4b6-4cc4-a163-894714367e5d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:55 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda (e02ab18a-eb17-428e-9ad4-1a7378e8fbda): created successfully
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8e947a9f-a4b6-4cc4-a163-894714367e5d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Flow 'volume_create_manager' (7bc546e5-bf54-48f2-ad11-2b9af18efa59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a 1073741824" returned: 0 in 0.573s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:55 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-623e5523-07ad-4f2f-a752-330439d0ca94 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created volume successfully.
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a" returned: 0 in 0.246s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] <== create_volume: return (850ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:44:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.867s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.424s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:44:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1093252854',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6ed702b-d31f-478d-b385-fc0e7a6c632b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='3107ee7e1f604191a1e30acd39d7ce53',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:44:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:44:53Z,use_quota=True,user_id='db2f845fdd374479ae6ae4653fff6aa8',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Creating volume a6ed702b-d31f-478d-b385-fc0e7a6c632b {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:44:56 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:56 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=130, name=volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f90faae4-2b7c-41e2-9d20-66d52f894b5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff961b5-2e07-481d-8ee3-a9bc0e5aee4c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b 1073741824" returned: 0 in 0.495s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:56 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a (57a94da4-d1fb-4fc6-bbe7-6d607cfac98a): created successfully
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (5ff961b5-2e07-481d-8ee3-a9bc0e5aee4c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Flow 'volume_create_manager' (256f96b0-3cb1-4990-bf5a-759885374420) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b" returned: 0 in 0.367s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] <== create_volume: return (895ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.915s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:56 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-01bc3ba0-784e-4d0f-a9f1-6bae48254a3d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created volume successfully.
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c61b705e-9da5-43bc-a492-5690914f7b20) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55b3aef-f8c7-4d28-b274-9c2425a1f6a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:44:57 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b (a6ed702b-d31f-478d-b385-fc0e7a6c632b): created successfully
Sep 24 18:44:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a55b3aef-f8c7-4d28-b274-9c2425a1f6a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:44:57 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Flow 'volume_create_manager' (9882e53d-d491-4f7c-90a2-c836ffb49a12) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:44:57 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1848a2b0-858c-4309-84e2-951f25682db4 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created volume successfully.
Sep 24 18:44:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-a6ed702b-d31f-478d-b385-fc0e7a6c632b-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:44:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-a6ed702b-d31f-478d-b385-fc0e7a6c632b-delete_volume" acquired by "delete_volume" :: waited 0.075s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:44:58 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:44:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-quobyte-a6ed702b-d31f-478d-b385-fc0e7a6c632b" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:44:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-a6ed702b-d31f-478d-b385-fc0e7a6c632b" acquired by "delete_volume" :: waited 0.017s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:44:58 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ef45d343-7066-4b0b-b845-ea1f2370ba7e]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:44:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:58 devstack quobyte-client[84204]: System call of process 99692 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:44:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b" returned: 0 in 0.401s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6ed702b-d31f-478d-b385-fc0e7a6c632b" returned: 0 in 0.123s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-a6ed702b-d31f-478d-b385-fc0e7a6c632b" released by "delete_volume" :: held 0.705s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:44:59 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created reservations ['c45e9f0e-ce97-4396-94a2-de79d6dba8e0', '7a9642ae-f057-40fc-9f94-826e29d5b6bc', '059fd7c7-dcff-42d7-8771-6aa8e08ebc46', 'b821df1a-d37c-401c-bcc4-30b07ac13f9a'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:44:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:44:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:44:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:44:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:44:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.021s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:44:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:44:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.097s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:44:59 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:44:59 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Deleted volume successfully.
Sep 24 18:44:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b9c61793-9e2c-4e12-b48f-0e6a2eab8494 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-a6ed702b-d31f-478d-b385-fc0e7a6c632b-delete_volume" released by "delete_volume" :: held 1.665s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a-delete_volume" acquired by "delete_volume" :: waited 0.070s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:00 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-quobyte-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a" acquired by "delete_volume" :: waited 0.016s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:00 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[53b7d927-1dd4-48a2-b232-9517be903f83]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:01 devstack quobyte-client[84204]: System call of process 99705 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:01 devstack quobyte-client[84204]: System call of process 99705 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a" returned: 0 in 0.684s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a" returned: 0 in 0.435s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-526ae83d-c13e-4662-8a60-d36dae90fd72 req-a4982778-c89f-422d-8d5e-58930b100bf5 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-526ae83d-c13e-4662-8a60-d36dae90fd72 req-a4982778-c89f-422d-8d5e-58930b100bf5 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a" released by "delete_volume" :: held 1.295s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:02 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[fbe29863-8904-462e-a6a3-1ffb1e741a5e]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-526ae83d-c13e-4662-8a60-d36dae90fd72 req-a4982778-c89f-422d-8d5e-58930b100bf5 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9fc236da-d809-4d06-a8ec-907f95dfa569 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:02 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created reservations ['c14fa85f-f47a-415f-9666-ea5a91f7883c', '54b1c809-4baa-47bd-b490-3eadf62e38ef', '217d3034-79d5-401c-a8af-6b038bad6428', '7e962ad5-e39e-438d-acad-6df84c38e939'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:45:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.008s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:02 devstack quobyte-client[84204]: System call of process 99721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:02 devstack quobyte-client[84204]: System call of process 99721 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:02 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:45:02 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:45:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.043s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-e02ab18a-eb17-428e-9ad4-1a7378e8fbda-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [req-526ae83d-c13e-4662-8a60-d36dae90fd72 req-a4982778-c89f-422d-8d5e-58930b100bf5 tempest-TestServerVolumeAttachmentScenario-1091402776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9fc236da-d809-4d06-a8ec-907f95dfa569" returned: 0 in 1.088s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [req-526ae83d-c13e-4662-8a60-d36dae90fd72 req-a4982778-c89f-422d-8d5e-58930b100bf5 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.initialize_connection" :: held 1.177s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.459s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:03 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:45:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-e02ab18a-eb17-428e-9ad4-1a7378e8fbda-delete_volume" acquired by "delete_volume" :: waited 0.259s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:03 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Deleted volume successfully.
Sep 24 18:45:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ef620695-1ac4-48b1-a046-cf1322841e6e tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-57a94da4-d1fb-4fc6-bbe7-6d607cfac98a-delete_volume" released by "delete_volume" :: held 2.966s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:03 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-526ae83d-c13e-4662-8a60-d36dae90fd72 req-a4982778-c89f-422d-8d5e-58930b100bf5 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Connection info returned from driver {'export': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b', 'name': 'volume-9fc236da-d809-4d06-a8ec-907f95dfa569', 'options': None, 'format': 'qcow2', 'qos_specs': None, 'access_mode': 'rw', 'encrypted': False, 'cacheable': False, 'driver_volume_type': 'quobyte', 'mount_point_base': '/opt/stack/data/cinder/mnt', 'attachment_id': 'e6a94218-fd62-429f-bcc6-8a926400bdff', 'enforce_multipath': True} {{(pid=84177) _connection_create /opt/stack/cinder/cinder/volume/manager.py:4891}}
Sep 24 18:45:03 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-526ae83d-c13e-4662-8a60-d36dae90fd72 req-a4982778-c89f-422d-8d5e-58930b100bf5 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:03 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-quobyte-e02ab18a-eb17-428e-9ad4-1a7378e8fbda" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-e02ab18a-eb17-428e-9ad4-1a7378e8fbda" acquired by "delete_volume" :: waited 0.050s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:03 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e9de0c48-fee3-4dc2-a8f1-5896c7fbac01]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:03 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-526ae83d-c13e-4662-8a60-d36dae90fd72 req-a4982778-c89f-422d-8d5e-58930b100bf5 tempest-TestServerVolumeAttachmentScenario-1091402776 None] attachment_update completed successfully.
Sep 24 18:45:04 devstack quobyte-client[84204]: System call of process 99726 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda" returned: 0 in 0.621s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e02ab18a-eb17-428e-9ad4-1a7378e8fbda" returned: 0 in 0.133s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-e02ab18a-eb17-428e-9ad4-1a7378e8fbda" released by "delete_volume" :: held 0.928s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:04 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created reservations ['663bf07e-2418-47b9-9968-f7c7aa192fea', 'ab6361ef-8ce0-4979-a326-6880593a0772', 'd8bcff02-8b08-4624-af13-72eb0e7e561c', '7c2f15bb-7b0c-4d8b-9c36-6c1d2446b1b2'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:45:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:45:04 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:45:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.103s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:05 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:45:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Deleted volume successfully.
Sep 24 18:45:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-70fccb14-a7e0-4350-81b3-60fdfb154733 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-e02ab18a-eb17-428e-9ad4-1a7378e8fbda-delete_volume" released by "delete_volume" :: held 1.980s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-e119a5f9-da29-49c7-8503-7fcc90c22971-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-e119a5f9-da29-49c7-8503-7fcc90c22971-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:05 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-quobyte-e119a5f9-da29-49c7-8503-7fcc90c22971" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-e119a5f9-da29-49c7-8503-7fcc90c22971" acquired by "delete_volume" :: waited 0.013s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:05 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8942bc14-6f52-418a-b578-d897de0c6f38]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e119a5f9-da29-49c7-8503-7fcc90c22971 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e119a5f9-da29-49c7-8503-7fcc90c22971" returned: 0 in 0.522s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e119a5f9-da29-49c7-8503-7fcc90c22971 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e119a5f9-da29-49c7-8503-7fcc90c22971" returned: 0 in 0.110s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-e119a5f9-da29-49c7-8503-7fcc90c22971" released by "delete_volume" :: held 0.794s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:06 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created reservations ['393cfb57-f450-4ee1-93b8-5335489cd6f9', '1bb957c0-8e3f-4c83-94bc-45d029f5e496', '07d99bd6-d8c1-4bd1-812b-b2790c72303c', '5aa8d6bb-5157-467f-8224-149ebf20fc57'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:45:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:45:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:45:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.086s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:07 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:45:07 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Deleted volume successfully.
Sep 24 18:45:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-3d284c2a-60e6-4cb8-a309-e11d7d881f92 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-e119a5f9-da29-49c7-8503-7fcc90c22971-delete_volume" released by "delete_volume" :: held 1.843s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-e0844c32-4bd1-4e82-8e97-75681795119f-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-e0844c32-4bd1-4e82-8e97-75681795119f-delete_volume" acquired by "delete_volume" :: waited 0.036s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:07 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-quobyte-e0844c32-4bd1-4e82-8e97-75681795119f" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-e0844c32-4bd1-4e82-8e97-75681795119f" acquired by "delete_volume" :: waited 0.010s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:07 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[31090392-d8f6-428b-84fe-1158fac2df0f]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e0844c32-4bd1-4e82-8e97-75681795119f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:08 devstack quobyte-client[84204]: System call of process 99748 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e0844c32-4bd1-4e82-8e97-75681795119f" returned: 0 in 0.426s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e0844c32-4bd1-4e82-8e97-75681795119f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e0844c32-4bd1-4e82-8e97-75681795119f" returned: 0 in 0.124s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:08 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-e0844c32-4bd1-4e82-8e97-75681795119f" released by "delete_volume" :: held 0.720s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:08 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created reservations ['ccaa12f5-3aed-4712-a5df-a75c261ed878', 'e4b904a1-9a81-497a-8a36-9b697d4ad87f', '18f8c8a0-d0f6-4d89-b993-5336ae96487d', '43a37b29-b917-4a90-893f-67584ac475a1'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:45:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:45:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:45:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.016s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.139s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:09 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:45:09 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Deleted volume successfully.
Sep 24 18:45:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a3a6be7e-96a6-417a-9b9e-a49739f74d7f tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-e0844c32-4bd1-4e82-8e97-75681795119f-delete_volume" released by "delete_volume" :: held 1.924s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-298fe433-cab8-4dbb-a30e-d4d898b96bb7-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-298fe433-cab8-4dbb-a30e-d4d898b96bb7-delete_snapshot" acquired by "delete_snapshot" :: waited 0.049s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:10 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-quobyte-6f255c7b-6419-4921-9531-3b07966dea21" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-6f255c7b-6419-4921-9531-3b07966dea21" acquired by "delete_snapshot" :: waited 0.031s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-quobyte-298fe433-cab8-4dbb-a30e-d4d898b96bb7" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-298fe433-cab8-4dbb-a30e-d4d898b96bb7" acquired by "_delete_snapshot" :: waited 0.010s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Deleting offline snapshot 298fe433-cab8-4dbb-a30e-d4d898b96bb7 of volume 6f255c7b-6419-4921-9531-3b07966dea21 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] snapshot_file for this snap is: volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9e376f1a-74ca-431c-9bf7-f8e0b20f01d7]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7" returned: 0 in 0.385s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-6f255c7b-6419-4921-9531-3b07966dea21(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[01d6bcf8-d003-4894-a4f7-7d884ab92ef1]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:11 devstack quobyte-client[84204]: System call of process 99812 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21" returned: 0 in 0.425s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:11 devstack quobyte-client[84204]: System call of process 99816 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:11 devstack quobyte-client[84204]: System call of process 99816 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7" returned: 0 in 0.330s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21.298fe433-cab8-4dbb-a30e-d4d898b96bb7" returned: 0 in 0.100s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-298fe433-cab8-4dbb-a30e-d4d898b96bb7" released by "_delete_snapshot" :: held 1.583s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-6f255c7b-6419-4921-9531-3b07966dea21" released by "delete_snapshot" :: held 1.608s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:12 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created reservations ['936342bf-b69f-4d68-a65d-a0afd6c0c0cb', '66a08a64-596c-4bd6-805e-9ad3ba720c2f', 'b7269761-f54d-421f-9e48-80c101eaf4db', '91d490c9-bd35-482c-a777-437cfbb8bf0c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:45:12 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Delete snapshot completed successfully.
Sep 24 18:45:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bcb2267a-76f6-4d02-b052-95dcdb62c250 tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-298fe433-cab8-4dbb-a30e-d4d898b96bb7-delete_snapshot" released by "delete_snapshot" :: held 2.115s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:45:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:45:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:45:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.086s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:45:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-6f255c7b-6419-4921-9531-3b07966dea21-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-6f255c7b-6419-4921-9531-3b07966dea21-delete_volume" acquired by "delete_volume" :: waited 0.072s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:13 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "cinder-quobyte-6f255c7b-6419-4921-9531-3b07966dea21" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-6f255c7b-6419-4921-9531-3b07966dea21" acquired by "delete_volume" :: waited 0.010s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:13 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[14ccc0a0-f2f1-45df-99b1-7e845cd4af62]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21" returned: 0 in 0.400s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f255c7b-6419-4921-9531-3b07966dea21" returned: 0 in 0.096s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-quobyte-6f255c7b-6419-4921-9531-3b07966dea21" released by "delete_volume" :: held 0.670s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Created reservations ['cddd496f-106f-40ef-a898-128519c42e9c', 'e62b7a33-5c88-4588-b15f-dfd26bd432f4', '205cb6d5-8386-405c-b7b4-0075414a63d8', '2395a9a8-0273-4b24-ab10-1a6280e92659'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.082s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:45:14 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Deleted volume successfully.
Sep 24 18:45:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-035dac6e-27fa-4903-8c25-0b46393dc24d tempest-CreateVolumesFromSnapshotTest-1221444267 None] Lock "cinder-6f255c7b-6419-4921-9531-3b07966dea21-delete_volume" released by "delete_volume" :: held 1.619s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:18 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Flow 'volume_create_manager' (56f45d97-685a-4666-99dc-d2caa99c7ddd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd045df-c5a7-47c3-97cb-f0bc15043e98) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fd045df-c5a7-47c3-97cb-f0bc15043e98) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4dc9276-8e27-4332-bf4e-3c38f91ca3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbad4452163461a8999fe5783749b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:45:18Z,use_quota=True,user_id='96de113082624c79873c7955605d0322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e6989c-fe87-40f1-8913-4c3d6d29813f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (09e6989c-fe87-40f1-8913-4c3d6d29813f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9a8e8a-f3d9-4fe8-82c2-9e78300dbb38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5b9a8e8a-f3d9-4fe8-82c2-9e78300dbb38) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f4dc9276-8e27-4332-bf4e-3c38f91ca3c3', 'volume_name': 'volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c3cb36-c6e9-40d5-b03e-ebfec88d6111) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (95c3cb36-c6e9-40d5-b03e-ebfec88d6111) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba40cc4b-ae99-4e11-b860-90e1ecb2ecee) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:45:18 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Volume f4dc9276-8e27-4332-bf4e-3c38f91ca3c3: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3', 'volume_size': 1}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:45:18Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f4dc9276-8e27-4332-bf4e-3c38f91ca3c3,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbad4452163461a8999fe5783749b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:45:18Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:45:18Z,use_quota=True,user_id='96de113082624c79873c7955605d0322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Creating volume f4dc9276-8e27-4332-bf4e-3c38f91ca3c3 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:45:18 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:18 devstack quobyte-client[84204]: System call of process 99831 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:18 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=131, name=volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3 1073741824" returned: 0 in 0.318s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3" returned: 0 in 0.081s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] <== create_volume: return (467ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.479s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ba40cc4b-ae99-4e11-b860-90e1ecb2ecee) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:45:18 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db10df3c-92de-461e-adbb-8591056d34ca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:45:19 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Volume volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3 (f4dc9276-8e27-4332-bf4e-3c38f91ca3c3): created successfully
Sep 24 18:45:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (db10df3c-92de-461e-adbb-8591056d34ca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:45:19 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Flow 'volume_create_manager' (56f45d97-685a-4666-99dc-d2caa99c7ddd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:45:19 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-6294434c-2be2-45f1-b966-a620e474190b tempest-CinderUnicodeTest-109247767 None] Created volume successfully.
Sep 24 18:45:20 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Flow 'volume_create_manager' (ae5c76c7-ba06-425b-a756-a4a6502291dd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3ca0a8-32af-4b57-8ce3-eddd62a5b57d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3f3ca0a8-32af-4b57-8ce3-eddd62a5b57d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:45:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-538251714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b54c08-047c-4339-af5d-aa6aaf04e7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbad4452163461a8999fe5783749b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:45:21Z,use_quota=True,user_id='96de113082624c79873c7955605d0322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4b0540-38cf-439c-b4ef-21073f2cd5a8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3f4b0540-38cf-439c-b4ef-21073f2cd5a8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ee9cbc-ddb8-45a7-a9e6-2127d9fc3010) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (a7ee9cbc-ddb8-45a7-a9e6-2127d9fc3010) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '00b54c08-047c-4339-af5d-aa6aaf04e7de', 'volume_name': 'volume-00b54c08-047c-4339-af5d-aa6aaf04e7de', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b890110-625e-41f6-b2b1-3f3b1ba25680) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (3b890110-625e-41f6-b2b1-3f3b1ba25680) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97d28f3-1ade-48b5-868d-6e9f9c91e973) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:45:20 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Volume 00b54c08-047c-4339-af5d-aa6aaf04e7de: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-00b54c08-047c-4339-af5d-aa6aaf04e7de', 'volume_size': 1}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:45:20Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-538251714',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=00b54c08-047c-4339-af5d-aa6aaf04e7de,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='fcbad4452163461a8999fe5783749b12',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:45:21Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:45:21Z,use_quota=True,user_id='96de113082624c79873c7955605d0322',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Creating volume 00b54c08-047c-4339-af5d-aa6aaf04e7de {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:45:20 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:45:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:21 devstack quobyte-client[84204]: System call of process 99835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:21 devstack quobyte-client[84204]: System call of process 99835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:21 devstack quobyte-client[84204]: System call of process 99835 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:21 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=132, name=volume-00b54c08-047c-4339-af5d-aa6aaf04e7de, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:45:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de 1073741824" returned: 0 in 0.361s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de" returned: 0 in 0.084s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] <== create_volume: return (513ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:45:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.526s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d97d28f3-1ade-48b5-868d-6e9f9c91e973) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-00b54c08-047c-4339-af5d-aa6aaf04e7de', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:45:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c931b092-b491-445d-ae2d-dd762788605d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:45:21 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Volume volume-00b54c08-047c-4339-af5d-aa6aaf04e7de (00b54c08-047c-4339-af5d-aa6aaf04e7de): created successfully
Sep 24 18:45:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c931b092-b491-445d-ae2d-dd762788605d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:45:21 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Flow 'volume_create_manager' (ae5c76c7-ba06-425b-a756-a4a6502291dd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:45:21 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-fbcb07f5-b8c4-48bd-acfe-bb49a31e1b20 tempest-CinderUnicodeTest-109247767 None] Created volume successfully.
Sep 24 18:45:23 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:23 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Creating offline snapshot 479bbf6d-87b2-4e45-ace1-aca76e45ba5c of volume 00b54c08-047c-4339-af5d-aa6aaf04e7de {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:45:23 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c87a9275-b78d-417a-847a-9b05a191c5fb]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de" returned: 0 in 0.401s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:23 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=133, name=volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:45:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c 1G" returned: 0 in 0.239s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): qemu-img rebase -u -b volume-00b54c08-047c-4339-af5d-aa6aaf04e7de -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] CMD "qemu-img rebase -u -b volume-00b54c08-047c-4339-af5d-aa6aaf04e7de -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c" returned: 0 in 0.126s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:23 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:45:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c" returned: 0 in 0.094s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:45:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c" returned: 0 in 0.102s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.info" returned: 0 in 0.087s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:45:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.info" returned: 0 in 0.088s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.455s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:24 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-f0d4cd56-9077-4d30-8512-0cb4a26b8c3e tempest-CinderUnicodeTest-109247767 None] Create snapshot completed successfully
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Acquiring lock "cinder-479bbf6d-87b2-4e45-ace1-aca76e45ba5c-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-479bbf6d-87b2-4e45-ace1-aca76e45ba5c-delete_snapshot" acquired by "delete_snapshot" :: waited 0.046s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:25 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Acquiring lock "cinder-quobyte-00b54c08-047c-4339-af5d-aa6aaf04e7de" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-quobyte-00b54c08-047c-4339-af5d-aa6aaf04e7de" acquired by "delete_snapshot" :: waited 0.009s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Acquiring lock "cinder-quobyte-479bbf6d-87b2-4e45-ace1-aca76e45ba5c" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-quobyte-479bbf6d-87b2-4e45-ace1-aca76e45ba5c" acquired by "_delete_snapshot" :: waited 0.008s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Deleting offline snapshot 479bbf6d-87b2-4e45-ace1-aca76e45ba5c of volume 00b54c08-047c-4339-af5d-aa6aaf04e7de {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] snapshot_file for this snap is: volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[08a7f9bc-c364-4980-bcfc-87ce48d852f8]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c" returned: 0 in 0.382s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-00b54c08-047c-4339-af5d-aa6aaf04e7de(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6d40d2e1-57c5-43fe-aa8c-3fcdb0592608]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de" returned: 0 in 0.398s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:26 devstack quobyte-client[84204]: System call of process 99859 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:45:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c" returned: 0 in 0.245s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de.479bbf6d-87b2-4e45-ace1-aca76e45ba5c" returned: 0 in 0.082s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-quobyte-479bbf6d-87b2-4e45-ace1-aca76e45ba5c" released by "_delete_snapshot" :: held 1.409s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-quobyte-00b54c08-047c-4339-af5d-aa6aaf04e7de" released by "delete_snapshot" :: held 1.429s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:27 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Created reservations ['1fb1ed4d-cb10-4be9-9eaf-7e469ffa45cf', 'ac28bd60-b8fd-4203-aef5-53ca90996ff4', '7b19cadb-3220-408b-816f-c8ae4b119bcb', '2265ca91-e9e1-4581-8125-883ab40aafcc'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:45:27 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Delete snapshot completed successfully.
Sep 24 18:45:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-315e786d-09fd-4bfb-b96f-83975c48cd90 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-479bbf6d-87b2-4e45-ace1-aca76e45ba5c-delete_snapshot" released by "delete_snapshot" :: held 1.832s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Acquiring lock "cinder-00b54c08-047c-4339-af5d-aa6aaf04e7de-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-00b54c08-047c-4339-af5d-aa6aaf04e7de-delete_volume" acquired by "delete_volume" :: waited 0.020s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:27 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Acquiring lock "cinder-quobyte-00b54c08-047c-4339-af5d-aa6aaf04e7de" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-quobyte-00b54c08-047c-4339-af5d-aa6aaf04e7de" acquired by "delete_volume" :: waited 0.011s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:27 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[bc3f4287-c942-481a-9eb3-3bd66915e162]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de" returned: 0 in 0.399s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-00b54c08-047c-4339-af5d-aa6aaf04e7de" returned: 0 in 0.111s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-quobyte-00b54c08-047c-4339-af5d-aa6aaf04e7de" released by "delete_volume" :: held 0.664s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Created reservations ['68ecf248-3f4f-4595-b0e2-59363ec953d6', 'a0a0ed16-9e08-48fc-87a4-3f3288b2e7ac', 'cd51dee2-5249-4142-b236-8b13bc29775b', '6845615e-1afe-4211-8f4a-01aa028a6da4'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Acquiring lock "cinder-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.328s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:45:28 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3-delete_volume" acquired by "delete_volume" :: waited 0.172s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:29 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Deleted volume successfully.
Sep 24 18:45:29 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b541d4c4-c1e3-4798-934f-76f0c80fa463 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-00b54c08-047c-4339-af5d-aa6aaf04e7de-delete_volume" released by "delete_volume" :: held 1.638s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:29 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:29 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Acquiring lock "cinder-quobyte-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:45:29 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-quobyte-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3" acquired by "delete_volume" :: waited 0.011s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:45:29 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[157f18d2-4646-4158-a785-d05e6a0016f1]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:45:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3" returned: 0 in 0.398s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3" returned: 0 in 0.089s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:29 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-quobyte-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3" released by "delete_volume" :: held 0.650s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:30 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Created reservations ['88406efa-761e-49b5-b17b-693f7309b82e', '27ccec61-02eb-4af6-8e6d-40f71dc3ce71', '5985d678-b820-428a-b8df-5e85240f595e', '00783751-f796-4d42-91f1-244b7002f1dd'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:45:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:45:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:45:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:45:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:45:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:45:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:45:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.086s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:45:30 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:45:30 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Deleted volume successfully.
Sep 24 18:45:30 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-31b41102-ef4d-4a90-8882-6f76793ab5e5 tempest-CinderUnicodeTest-109247767 None] Lock "cinder-f4dc9276-8e27-4332-bf4e-3c38f91ca3c3-delete_volume" released by "delete_volume" :: held 1.585s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:45:32 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-f6d6b066-5f20-41d8-b6c0-9dfd561fab11 req-2585f939-29c9-4018-ba51-625984c1823e tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:32 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-f6d6b066-5f20-41d8-b6c0-9dfd561fab11 req-2585f939-29c9-4018-ba51-625984c1823e tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:32 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-f6d6b066-5f20-41d8-b6c0-9dfd561fab11 req-2585f939-29c9-4018-ba51-625984c1823e tempest-TestServerVolumeAttachmentScenario-1091402776 None] Terminate volume connection completed successfully.
Sep 24 18:45:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-f6d6b066-5f20-41d8-b6c0-9dfd561fab11 req-2585f939-29c9-4018-ba51-625984c1823e tempest-TestServerVolumeAttachmentScenario-1091402776 None] Deleting attachment e6a94218-fd62-429f-bcc6-8a926400bdff. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:45:42 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=68,cinder:UPDATE=100,cinder:DELETE=9,cinder:INSERT=19 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:45:46 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=93,cinder:SELECT=77,cinder:DELETE=9,cinder:INSERT=21 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:45:56 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-4c145537-fee0-4071-87d6-6922280b5804 req-ad4d1d8d-a5e6-4f94-8f78-ebb9e2aeb3e2 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:56 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [req-4c145537-fee0-4071-87d6-6922280b5804 req-ad4d1d8d-a5e6-4f94-8f78-ebb9e2aeb3e2 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:45:56 devstack cinder-volume[84177]: INFO cinder.volume.manager [req-4c145537-fee0-4071-87d6-6922280b5804 req-ad4d1d8d-a5e6-4f94-8f78-ebb9e2aeb3e2 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Terminate volume connection completed successfully.
Sep 24 18:45:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [req-4c145537-fee0-4071-87d6-6922280b5804 req-ad4d1d8d-a5e6-4f94-8f78-ebb9e2aeb3e2 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Deleting attachment 87a2a7b4-1086-4b92-a69b-3dca143a19b5. {{(pid=84177) attachment_delete /opt/stack/cinder/cinder/volume/manager.py:5022}}
Sep 24 18:46:06 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:46:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Acquiring lock "cinder-9fc236da-d809-4d06-a8ec-907f95dfa569-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "cinder-9fc236da-d809-4d06-a8ec-907f95dfa569-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:10 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Acquiring lock "cinder-quobyte-9fc236da-d809-4d06-a8ec-907f95dfa569" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "cinder-quobyte-9fc236da-d809-4d06-a8ec-907f95dfa569" acquired by "delete_volume" :: waited 0.013s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:11 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6f97dc33-8d06-4cd7-a2cc-583bbe326932]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:46:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9fc236da-d809-4d06-a8ec-907f95dfa569 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:11 devstack quobyte-client[84204]: System call of process 100027 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9fc236da-d809-4d06-a8ec-907f95dfa569" returned: 0 in 0.417s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9fc236da-d809-4d06-a8ec-907f95dfa569 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-9fc236da-d809-4d06-a8ec-907f95dfa569" returned: 0 in 0.098s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:11 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "cinder-quobyte-9fc236da-d809-4d06-a8ec-907f95dfa569" released by "delete_volume" :: held 0.663s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:11 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Created reservations ['5ad98bf8-73c2-402e-bfae-32e6f4481363', 'ef0b1043-3a8c-436a-b3e2-59dd55d8f497', 'd8b08aa1-d7f8-4d7d-8b63-db9352eb0221', '9f62a158-41a5-4642-91aa-c904376cc608'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.127s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Acquiring lock "cinder-35f666b1-32d2-457e-9bc4-ef4d6d2162b2-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:12 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Deleted volume successfully.
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "cinder-35f666b1-32d2-457e-9bc4-ef4d6d2162b2-delete_volume" acquired by "delete_volume" :: waited 0.153s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-753bddd5-0bbe-436c-8f71-d46c7d594fbb tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "cinder-9fc236da-d809-4d06-a8ec-907f95dfa569-delete_volume" released by "delete_volume" :: held 1.620s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:12 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Acquiring lock "cinder-quobyte-35f666b1-32d2-457e-9bc4-ef4d6d2162b2" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "cinder-quobyte-35f666b1-32d2-457e-9bc4-ef4d6d2162b2" acquired by "delete_volume" :: waited 0.077s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.271s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[85440198-497a-4330-96f1-6f8cbd47fc9f]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:46:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:13 devstack quobyte-client[84204]: System call of process 100033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:13 devstack quobyte-client[84204]: System call of process 100033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:13 devstack quobyte-client[84204]: System call of process 100033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:13 devstack quobyte-client[84204]: System call of process 100033 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2" returned: 0 in 0.443s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-35f666b1-32d2-457e-9bc4-ef4d6d2162b2" returned: 0 in 0.086s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:13 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "cinder-quobyte-35f666b1-32d2-457e-9bc4-ef4d6d2162b2" released by "delete_volume" :: held 0.726s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:13 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Created reservations ['bdd2044b-78e5-44a3-a354-7c64664461a3', '71f9693b-f426-449f-bcb9-4e48e0b2012d', '7349b34d-09da-4aab-be67-4243259e0e75', 'f887699d-a319-485a-8ba2-f91a8a4b9752'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:46:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.085s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:14 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:46:14 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Deleted volume successfully.
Sep 24 18:46:14 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-aa853a9a-dff4-45fd-8061-9de001008370 tempest-TestServerVolumeAttachmentScenario-1091402776 None] Lock "cinder-35f666b1-32d2-457e-9bc4-ef4d6d2162b2-delete_volume" released by "delete_volume" :: held 1.818s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:23 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=21,cinder:SELECT=12,cinder:INSERT=5 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:46:24 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=8,cinder:INSERT=3,cinder:UPDATE=11,cinder:DELETE=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:46:29 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Flow 'volume_create_manager' (98bfd9f5-ceda-4bed-8eac-ef8326943dc1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c46f8d-64e3-4859-b5a2-d8335a162ace) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58c46f8d-64e3-4859-b5a2-d8335a162ace) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1155846845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502a4404-f7a0-4933-a3ff-4cda338cfed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648d93f06a564ffd9f919989039b3a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:29Z,use_quota=True,user_id='4f916fc6e5084f7b92986ae172e4f376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aaa7ca-74b0-4d0f-8103-20765a355471) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (00aaa7ca-74b0-4d0f-8103-20765a355471) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1995413b-4745-4e01-9548-8f4c53212029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1995413b-4745-4e01-9548-8f4c53212029) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '502a4404-f7a0-4933-a3ff-4cda338cfed4', 'volume_name': 'volume-502a4404-f7a0-4933-a3ff-4cda338cfed4', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd88cea-97a2-4482-8a2d-fed02bc83ad7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (bcd88cea-97a2-4482-8a2d-fed02bc83ad7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503a868e-2761-421b-8f6a-f41c53db8611) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:29 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Volume 502a4404-f7a0-4933-a3ff-4cda338cfed4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-502a4404-f7a0-4933-a3ff-4cda338cfed4', 'volume_size': 1}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1155846845',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=502a4404-f7a0-4933-a3ff-4cda338cfed4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648d93f06a564ffd9f919989039b3a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:29Z,use_quota=True,user_id='4f916fc6e5084f7b92986ae172e4f376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Creating volume 502a4404-f7a0-4933-a3ff-4cda338cfed4 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:46:29 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-502a4404-f7a0-4933-a3ff-4cda338cfed4 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:29 devstack quobyte-client[84204]: System call of process 100044 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:29 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=135, name=volume-502a4404-f7a0-4933-a3ff-4cda338cfed4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-502a4404-f7a0-4933-a3ff-4cda338cfed4 1073741824" returned: 0 in 0.521s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-502a4404-f7a0-4933-a3ff-4cda338cfed4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:30 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Flow 'volume_create_manager' (01fb95f0-0a5f-45ec-ad0b-96d9f8096b0c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80e87ad-1afe-4974-913d-be59db4e6aa8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:30 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Flow 'volume_create_manager' (65e426d0-5ad4-4bcc-aaa5-27af5f331a30) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5016f002-7185-42c3-8e3b-9a8b5c4bd509) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-502a4404-f7a0-4933-a3ff-4cda338cfed4" returned: 0 in 0.570s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b80e87ad-1afe-4974-913d-be59db4e6aa8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419340280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f75c542-e02b-4082-9905-c67f5239fc19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648d93f06a564ffd9f919989039b3a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:30Z,use_quota=True,user_id='4f916fc6e5084f7b92986ae172e4f376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fdb408-59ee-429c-91ff-5b78f3eff25f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b3fdb408-59ee-429c-91ff-5b78f3eff25f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9491b5b-e7ff-4a55-acef-76b95ab01fab) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (b9491b5b-e7ff-4a55-acef-76b95ab01fab) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6f75c542-e02b-4082-9905-c67f5239fc19', 'volume_name': 'volume-6f75c542-e02b-4082-9905-c67f5239fc19', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125a2d94-c1d3-415f-b2e4-6cf74f27fd05) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (125a2d94-c1d3-415f-b2e4-6cf74f27fd05) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c482501-d76c-4d73-b202-3f467d47105f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:30 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Volume 6f75c542-e02b-4082-9905-c67f5239fc19: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6f75c542-e02b-4082-9905-c67f5239fc19', 'volume_size': 1}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5016f002-7185-42c3-8e3b-9a8b5c4bd509) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-17738815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baaa19fc-abee-4159-a7db-cffd43df281c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648d93f06a564ffd9f919989039b3a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:29Z,use_quota=True,user_id='4f916fc6e5084f7b92986ae172e4f376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fda1b68-0bf2-468e-88c7-c1861f2c2447) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9fda1b68-0bf2-468e-88c7-c1861f2c2447) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d983ddf1-c654-49dc-b012-df5bfb305dcc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d983ddf1-c654-49dc-b012-df5bfb305dcc) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'baaa19fc-abee-4159-a7db-cffd43df281c', 'volume_name': 'volume-baaa19fc-abee-4159-a7db-cffd43df281c', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6d585b-9036-46a5-8815-67de138481af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ae6d585b-9036-46a5-8815-67de138481af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e914a50-255e-40b9-991e-485c008b7824) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:30 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Volume baaa19fc-abee-4159-a7db-cffd43df281c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-baaa19fc-abee-4159-a7db-cffd43df281c', 'volume_size': 1}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] <== create_volume: return (1211ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.217s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.060s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1419340280',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6f75c542-e02b-4082-9905-c67f5239fc19,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648d93f06a564ffd9f919989039b3a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:30Z,use_quota=True,user_id='4f916fc6e5084f7b92986ae172e4f376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Creating volume 6f75c542-e02b-4082-9905-c67f5239fc19 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:46:30 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f75c542-e02b-4082-9905-c67f5239fc19 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:30 devstack quobyte-client[84204]: System call of process 100048 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:30 devstack quobyte-client[84204]: System call of process 100048 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:30 devstack quobyte-client[84204]: System call of process 100048 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:30 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=136, name=volume-6f75c542-e02b-4082-9905-c67f5239fc19, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (503a868e-2761-421b-8f6a-f41c53db8611) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-502a4404-f7a0-4933-a3ff-4cda338cfed4', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e037b4-f7ee-4759-9a17-2a6a5abf879f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:30 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Flow 'volume_create_manager' (a1f71f98-6551-4577-8fcd-88e56eddcc72) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:30 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6005cf00-8e76-49c8-92f8-78254d5ea6b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:31 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Flow 'volume_create_manager' (37faa836-1ce8-4207-a3ba-9e864a66620a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69cb261d-5bf4-43cf-b5ed-db23ed44728c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:31 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Volume volume-502a4404-f7a0-4933-a3ff-4cda338cfed4 (502a4404-f7a0-4933-a3ff-4cda338cfed4): created successfully
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (40e037b4-f7ee-4759-9a17-2a6a5abf879f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Flow 'volume_create_manager' (98bfd9f5-ceda-4bed-8eac-ef8326943dc1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69cb261d-5bf4-43cf-b5ed-db23ed44728c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-477972749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6379aca5-6958-4f48-8aef-d10659000d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648d93f06a564ffd9f919989039b3a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:30Z,use_quota=True,user_id='4f916fc6e5084f7b92986ae172e4f376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02c8251-5945-4c33-8804-de76a6fcad45) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f02c8251-5945-4c33-8804-de76a6fcad45) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96756cf-4fa0-437a-9c0b-d4e218ca08a9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c96756cf-4fa0-437a-9c0b-d4e218ca08a9) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6379aca5-6958-4f48-8aef-d10659000d6e', 'volume_name': 'volume-6379aca5-6958-4f48-8aef-d10659000d6e', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ff9cc5-c6b0-4cf9-879e-a8bcc761b286) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (e2ff9cc5-c6b0-4cf9-879e-a8bcc761b286) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39150ba5-d654-4437-a66e-2b807db9ddc0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:31 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Volume 6379aca5-6958-4f48-8aef-d10659000d6e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6379aca5-6958-4f48-8aef-d10659000d6e', 'volume_size': 1}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (6005cf00-8e76-49c8-92f8-78254d5ea6b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2074717464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9ea860-fee2-4bdf-8a29-414c19bc5771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648d93f06a564ffd9f919989039b3a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:30Z,use_quota=True,user_id='4f916fc6e5084f7b92986ae172e4f376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d42032d-21dc-46e1-aa62-1a725214743b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (9d42032d-21dc-46e1-aa62-1a725214743b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6e26de-35ff-447b-9e83-145e88d5af49) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (9b6e26de-35ff-447b-9e83-145e88d5af49) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5a9ea860-fee2-4bdf-8a29-414c19bc5771', 'volume_name': 'volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edff5a9-002b-4d1b-bb6f-b9444da4d7b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (1edff5a9-002b-4d1b-bb6f-b9444da4d7b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5610c736-5c7b-4998-b51f-c32f46bebe16) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:31 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Volume 5a9ea860-fee2-4bdf-8a29-414c19bc5771: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771', 'volume_size': 1}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:31 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-f8544c95-b58f-444d-ab00-97f9d200a59b tempest-CreateVolumesFromImageTest-1024237633 None] Created volume successfully.
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f75c542-e02b-4082-9905-c67f5239fc19 1073741824" returned: 0 in 0.714s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f75c542-e02b-4082-9905-c67f5239fc19 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f75c542-e02b-4082-9905-c67f5239fc19" returned: 0 in 0.303s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] <== create_volume: return (1054ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.064s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.144s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-17738815',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=baaa19fc-abee-4159-a7db-cffd43df281c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648d93f06a564ffd9f919989039b3a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:29Z,use_quota=True,user_id='4f916fc6e5084f7b92986ae172e4f376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Creating volume baaa19fc-abee-4159-a7db-cffd43df281c {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:46:31 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-baaa19fc-abee-4159-a7db-cffd43df281c 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:31 devstack quobyte-client[84204]: System call of process 100055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:31 devstack quobyte-client[84204]: System call of process 100055 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:31 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=137, name=volume-baaa19fc-abee-4159-a7db-cffd43df281c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (7c482501-d76c-4d73-b202-3f467d47105f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6f75c542-e02b-4082-9905-c67f5239fc19', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27e4192-9eec-4404-9152-61862154cf15) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-baaa19fc-abee-4159-a7db-cffd43df281c 1073741824" returned: 0 in 0.373s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-baaa19fc-abee-4159-a7db-cffd43df281c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:32 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Volume volume-6f75c542-e02b-4082-9905-c67f5239fc19 (6f75c542-e02b-4082-9905-c67f5239fc19): created successfully
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c27e4192-9eec-4404-9152-61862154cf15) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Flow 'volume_create_manager' (01fb95f0-0a5f-45ec-ad0b-96d9f8096b0c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-baaa19fc-abee-4159-a7db-cffd43df281c" returned: 0 in 0.294s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] <== create_volume: return (694ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.708s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.163s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-477972749',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6379aca5-6958-4f48-8aef-d10659000d6e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648d93f06a564ffd9f919989039b3a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:30Z,use_quota=True,user_id='4f916fc6e5084f7b92986ae172e4f376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Creating volume 6379aca5-6958-4f48-8aef-d10659000d6e {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:46:32 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6379aca5-6958-4f48-8aef-d10659000d6e 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:32 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=138, name=volume-6379aca5-6958-4f48-8aef-d10659000d6e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:46:32 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1c252f05-fafe-4f29-8365-b49ff13ed136 tempest-CreateVolumesFromImageTest-1024237633 None] Created volume successfully.
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2e914a50-255e-40b9-991e-485c008b7824) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-baaa19fc-abee-4159-a7db-cffd43df281c', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dada4c-4f94-4d44-acf3-ff512d86b9f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6379aca5-6958-4f48-8aef-d10659000d6e 1073741824" returned: 0 in 0.497s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6379aca5-6958-4f48-8aef-d10659000d6e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:33 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Volume volume-baaa19fc-abee-4159-a7db-cffd43df281c (baaa19fc-abee-4159-a7db-cffd43df281c): created successfully
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (14dada4c-4f94-4d44-acf3-ff512d86b9f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Flow 'volume_create_manager' (65e426d0-5ad4-4bcc-aaa5-27af5f331a30) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6379aca5-6958-4f48-8aef-d10659000d6e" returned: 0 in 0.276s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] <== create_volume: return (806ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.821s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.960s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-2074717464',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5a9ea860-fee2-4bdf-8a29-414c19bc5771,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='648d93f06a564ffd9f919989039b3a9a',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:30Z,use_quota=True,user_id='4f916fc6e5084f7b92986ae172e4f376',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Creating volume 5a9ea860-fee2-4bdf-8a29-414c19bc5771 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:46:33 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:33 devstack quobyte-client[84204]: System call of process 100063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:33 devstack quobyte-client[84204]: System call of process 100063 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:33 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=139, name=volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (39150ba5-d654-4437-a66e-2b807db9ddc0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6379aca5-6958-4f48-8aef-d10659000d6e', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350ee58d-cec3-4672-b721-e10a37949dce) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:33 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-6f50fa70-e8b3-4467-a562-43564dc62744 tempest-CreateVolumesFromImageTest-1024237633 None] Created volume successfully.
Sep 24 18:46:33 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Volume volume-6379aca5-6958-4f48-8aef-d10659000d6e (6379aca5-6958-4f48-8aef-d10659000d6e): created successfully
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (350ee58d-cec3-4672-b721-e10a37949dce) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Flow 'volume_create_manager' (37faa836-1ce8-4207-a3ba-9e864a66620a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771 1073741824" returned: 0 in 0.423s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:33 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-59ea6226-d52c-4f2b-b01d-ee8832efa5a4 tempest-CreateVolumesFromImageTest-1024237633 None] Created volume successfully.
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771" returned: 0 in 0.288s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] <== create_volume: return (740ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:46:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.755s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5610c736-5c7b-4998-b51f-c32f46bebe16) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8e3cab-0080-4ab0-ad8a-ae39d8441228) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:34 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Volume volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771 (5a9ea860-fee2-4bdf-8a29-414c19bc5771): created successfully
Sep 24 18:46:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7d8e3cab-0080-4ab0-ad8a-ae39d8441228) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Flow 'volume_create_manager' (a1f71f98-6551-4577-8fcd-88e56eddcc72) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:34 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-096f22ab-7a9d-4df5-b3b5-8ce8b79e35ba tempest-CreateVolumesFromImageTest-1024237633 None] Created volume successfully.
Sep 24 18:46:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "cinder-6379aca5-6958-4f48-8aef-d10659000d6e-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-6379aca5-6958-4f48-8aef-d10659000d6e-delete_volume" acquired by "delete_volume" :: waited 0.060s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:35 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "cinder-quobyte-6379aca5-6958-4f48-8aef-d10659000d6e" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-quobyte-6379aca5-6958-4f48-8aef-d10659000d6e" acquired by "delete_volume" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:35 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7353f69d-7213-4172-83c2-e5529aa8b97f]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:46:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6379aca5-6958-4f48-8aef-d10659000d6e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6379aca5-6958-4f48-8aef-d10659000d6e" returned: 0 in 0.427s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6379aca5-6958-4f48-8aef-d10659000d6e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6379aca5-6958-4f48-8aef-d10659000d6e" returned: 0 in 0.100s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:36 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-quobyte-6379aca5-6958-4f48-8aef-d10659000d6e" released by "delete_volume" :: held 0.670s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:36 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Created reservations ['65f23de7-5fa0-4cc8-b3ca-52b1ae12c080', 'a4bbc41a-41b6-43d1-af78-3d91558d4323', '00165db9-b970-4d28-a794-d895221b49c9', 'a00b8f80-6c65-42b5-9376-0901b4cb4a16'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:46:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:36 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.100s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:36 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:46:36 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Deleted volume successfully.
Sep 24 18:46:36 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d0127f54-5b0c-457f-9ec3-9d4e2d7ef6df tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-6379aca5-6958-4f48-8aef-d10659000d6e-delete_volume" released by "delete_volume" :: held 1.491s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:37 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "cinder-5a9ea860-fee2-4bdf-8a29-414c19bc5771-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:37 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-5a9ea860-fee2-4bdf-8a29-414c19bc5771-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:37 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:37 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "cinder-quobyte-5a9ea860-fee2-4bdf-8a29-414c19bc5771" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:37 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-quobyte-5a9ea860-fee2-4bdf-8a29-414c19bc5771" acquired by "delete_volume" :: waited 0.014s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:37 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[5552f693-e170-41a8-beb8-13357ffeb5e3]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:46:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771" returned: 0 in 0.371s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5a9ea860-fee2-4bdf-8a29-414c19bc5771" returned: 0 in 0.100s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-quobyte-5a9ea860-fee2-4bdf-8a29-414c19bc5771" released by "delete_volume" :: held 0.618s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Created reservations ['e06bcb7f-abc9-435d-9ecd-09fd21b9b749', '2dd1663d-7276-4cd4-9166-274ca79bf5d8', 'ce0028f7-c3ef-4c31-834a-e81b7922254d', '05ebc491-1849-4835-9266-16d6378d387e'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.102s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:38 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:46:38 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Deleted volume successfully.
Sep 24 18:46:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-01614960-38c6-458a-9100-3ab5b09700aa tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-5a9ea860-fee2-4bdf-8a29-414c19bc5771-delete_volume" released by "delete_volume" :: held 1.467s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "cinder-6f75c542-e02b-4082-9905-c67f5239fc19-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-6f75c542-e02b-4082-9905-c67f5239fc19-delete_volume" acquired by "delete_volume" :: waited 0.032s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:39 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "cinder-quobyte-6f75c542-e02b-4082-9905-c67f5239fc19" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-quobyte-6f75c542-e02b-4082-9905-c67f5239fc19" acquired by "delete_volume" :: waited 0.011s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:39 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2154a317-84e1-4a93-a432-08f82617a9ba]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:46:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f75c542-e02b-4082-9905-c67f5239fc19 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f75c542-e02b-4082-9905-c67f5239fc19" returned: 0 in 0.378s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f75c542-e02b-4082-9905-c67f5239fc19 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6f75c542-e02b-4082-9905-c67f5239fc19" returned: 0 in 0.119s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:40 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-quobyte-6f75c542-e02b-4082-9905-c67f5239fc19" released by "delete_volume" :: held 0.645s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:40 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Created reservations ['fae4580b-44cf-4295-9298-60339706f895', '37a6835a-77ae-4ad4-93e6-11e114513734', 'a046449a-dc34-48e1-80b8-97f5dcb30686', '0a0204cd-535d-4fb6-80ec-6e46e24f9d0c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:46:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:40 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:40 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.111s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:41 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:46:41 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Deleted volume successfully.
Sep 24 18:46:41 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-1fc14eda-4939-4b75-99b8-afb28bf85e8f tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-6f75c542-e02b-4082-9905-c67f5239fc19-delete_volume" released by "delete_volume" :: held 1.485s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "cinder-baaa19fc-abee-4159-a7db-cffd43df281c-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-baaa19fc-abee-4159-a7db-cffd43df281c-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:42 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "cinder-quobyte-baaa19fc-abee-4159-a7db-cffd43df281c" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-quobyte-baaa19fc-abee-4159-a7db-cffd43df281c" acquired by "delete_volume" :: waited 0.013s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:42 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[15c78e7d-314b-406b-a2fb-8866e548585e]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:46:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-baaa19fc-abee-4159-a7db-cffd43df281c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:42 devstack quobyte-client[84204]: System call of process 100085 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:42 devstack quobyte-client[84204]: System call of process 100085 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-baaa19fc-abee-4159-a7db-cffd43df281c" returned: 0 in 0.386s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-baaa19fc-abee-4159-a7db-cffd43df281c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-baaa19fc-abee-4159-a7db-cffd43df281c" returned: 0 in 0.113s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-quobyte-baaa19fc-abee-4159-a7db-cffd43df281c" released by "delete_volume" :: held 0.638s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:43 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Created reservations ['e84ca237-59c7-4311-ac97-3c750b4b4ead', '903798d3-74f8-4d42-b66a-f7c30d9f1456', '8c8840b6-df40-4c64-a3c6-d8b8ecf2d463', 'd07df374-c6fd-4d9e-bffb-81e2e0c6ac21'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:46:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.129s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:43 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:46:43 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Deleted volume successfully.
Sep 24 18:46:43 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-e91c8aa4-8d8d-4b55-aea2-66c0e534be1f tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-baaa19fc-abee-4159-a7db-cffd43df281c-delete_volume" released by "delete_volume" :: held 1.518s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:44 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "cinder-502a4404-f7a0-4933-a3ff-4cda338cfed4-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:44 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-502a4404-f7a0-4933-a3ff-4cda338cfed4-delete_volume" acquired by "delete_volume" :: waited 0.033s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:44 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:44 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "cinder-quobyte-502a4404-f7a0-4933-a3ff-4cda338cfed4" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:44 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-quobyte-502a4404-f7a0-4933-a3ff-4cda338cfed4" acquired by "delete_volume" :: waited 0.010s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:44 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ecb4d209-1b83-4a86-bc31-e7d15a271fa4]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:46:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-502a4404-f7a0-4933-a3ff-4cda338cfed4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-502a4404-f7a0-4933-a3ff-4cda338cfed4" returned: 0 in 0.369s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-502a4404-f7a0-4933-a3ff-4cda338cfed4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-502a4404-f7a0-4933-a3ff-4cda338cfed4" returned: 0 in 0.101s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-quobyte-502a4404-f7a0-4933-a3ff-4cda338cfed4" released by "delete_volume" :: held 0.609s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:45 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Created reservations ['0109c032-f343-4621-a6aa-2dc6abf184a1', '01839218-a716-4682-942c-4dd779c2464d', '0b131a1e-32be-40ee-9b00-f467eaa78f78', 'a2dcff87-60ee-442f-8683-b3f54f261cd6'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:46:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:45 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.085s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:45 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:46:45 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Deleted volume successfully.
Sep 24 18:46:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d810c2af-bc8a-432e-9d9c-210fc2e84648 tempest-CreateVolumesFromImageTest-1024237633 None] Lock "cinder-502a4404-f7a0-4933-a3ff-4cda338cfed4-delete_volume" released by "delete_volume" :: held 1.610s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:49 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Flow 'volume_create_manager' (362ed548-7017-4cb5-86d8-f5b8cfeb3652) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb5b882-8fe4-4fdc-b4ef-30e0ca65fdca) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (adb5b882-8fe4-4fdc-b4ef-30e0ca65fdca) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703290982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50498ff-3484-414f-b5ee-3c5d2880874b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110928c19cd34d63a436b49cf36b2a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:49Z,use_quota=True,user_id='2f1bde229b014dba89a4fc01d11de39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c310349-2890-4f2f-b37f-1ca42943f4af) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (4c310349-2890-4f2f-b37f-1ca42943f4af) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45def9bb-b47c-4761-82c4-3b82bfdf20ac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (45def9bb-b47c-4761-82c4-3b82bfdf20ac) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f50498ff-3484-414f-b5ee-3c5d2880874b', 'volume_name': 'volume-f50498ff-3484-414f-b5ee-3c5d2880874b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deaa5e17-f2a8-4e4e-8900-94b645c2e95c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (deaa5e17-f2a8-4e4e-8900-94b645c2e95c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9743109b-1e7f-47cd-966d-77a77f21b99a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:49 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume f50498ff-3484-414f-b5ee-3c5d2880874b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f50498ff-3484-414f-b5ee-3c5d2880874b', 'volume_size': 1}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:49Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-703290982',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f50498ff-3484-414f-b5ee-3c5d2880874b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110928c19cd34d63a436b49cf36b2a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:49Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:49Z,use_quota=True,user_id='2f1bde229b014dba89a4fc01d11de39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Creating volume f50498ff-3484-414f-b5ee-3c5d2880874b {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.008s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:46:49 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f50498ff-3484-414f-b5ee-3c5d2880874b 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:49 devstack quobyte-client[84204]: System call of process 100095 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:49 devstack quobyte-client[84204]: System call of process 100095 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:49 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=140, name=volume-f50498ff-3484-414f-b5ee-3c5d2880874b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f50498ff-3484-414f-b5ee-3c5d2880874b 1073741824" returned: 0 in 0.310s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f50498ff-3484-414f-b5ee-3c5d2880874b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f50498ff-3484-414f-b5ee-3c5d2880874b" returned: 0 in 0.080s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] <== create_volume: return (453ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.465s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9743109b-1e7f-47cd-966d-77a77f21b99a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f50498ff-3484-414f-b5ee-3c5d2880874b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42567b05-1a5b-4e03-81d7-2b4e5f45ae9b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:49 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume volume-f50498ff-3484-414f-b5ee-3c5d2880874b (f50498ff-3484-414f-b5ee-3c5d2880874b): created successfully
Sep 24 18:46:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (42567b05-1a5b-4e03-81d7-2b4e5f45ae9b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Flow 'volume_create_manager' (362ed548-7017-4cb5-86d8-f5b8cfeb3652) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:50 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e089b180-ee08-4f26-a39f-76f65a781097 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Created volume successfully.
Sep 24 18:46:51 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Flow 'volume_create_manager' (69ad284c-e1e3-438b-bf49-258a5d3b79fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fca9631-eca4-4c45-b56c-e7cf3509a3aa) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (3fca9631-eca4-4c45-b56c-e7cf3509a3aa) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1286645360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429870d2-cd06-471b-82a9-aa6bb5b208f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110928c19cd34d63a436b49cf36b2a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:51Z,use_quota=True,user_id='2f1bde229b014dba89a4fc01d11de39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8313fc37-d5a8-48ac-84de-0d4cd7b09323) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (8313fc37-d5a8-48ac-84de-0d4cd7b09323) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38720bc0-0ccf-4422-aa64-b0bcd218b9b3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (38720bc0-0ccf-4422-aa64-b0bcd218b9b3) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '429870d2-cd06-471b-82a9-aa6bb5b208f9', 'volume_name': 'volume-429870d2-cd06-471b-82a9-aa6bb5b208f9', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb0c42a-249c-486f-aba5-f526edc7b371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (abb0c42a-249c-486f-aba5-f526edc7b371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b11c92-be98-4419-9783-bc61849eaab0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:51 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume 429870d2-cd06-471b-82a9-aa6bb5b208f9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-429870d2-cd06-471b-82a9-aa6bb5b208f9', 'volume_size': 1}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:51Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1286645360',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=429870d2-cd06-471b-82a9-aa6bb5b208f9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110928c19cd34d63a436b49cf36b2a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:51Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:51Z,use_quota=True,user_id='2f1bde229b014dba89a4fc01d11de39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Creating volume 429870d2-cd06-471b-82a9-aa6bb5b208f9 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:46:51 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:46:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-429870d2-cd06-471b-82a9-aa6bb5b208f9 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:51 devstack quobyte-client[84204]: System call of process 100100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:51 devstack quobyte-client[84204]: System call of process 100100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:51 devstack quobyte-client[84204]: System call of process 100100 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:51 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=141, name=volume-429870d2-cd06-471b-82a9-aa6bb5b208f9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:46:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-429870d2-cd06-471b-82a9-aa6bb5b208f9 1073741824" returned: 0 in 0.445s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-429870d2-cd06-471b-82a9-aa6bb5b208f9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:52 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:52 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:46:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Flow 'volume_create_manager' (78560edd-75e8-4bbf-b14a-e83f6fdfc029) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d32e44e-7e02-4715-99a9-02bb60b04fd2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4d32e44e-7e02-4715-99a9-02bb60b04fd2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1161945929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d1ccd4-a012-46c5-89ec-20c44478a6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110928c19cd34d63a436b49cf36b2a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:52Z,use_quota=True,user_id='2f1bde229b014dba89a4fc01d11de39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dec131f-cef6-4d92-93b5-3dc2e58db576) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (0dec131f-cef6-4d92-93b5-3dc2e58db576) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dedd842-0a8a-461d-a6ca-f36d08fcef85) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (5dedd842-0a8a-461d-a6ca-f36d08fcef85) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77d1ccd4-a012-46c5-89ec-20c44478a6a5', 'volume_name': 'volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027c2ed9-6792-48fd-b4d8-52d4bd0ea27e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (027c2ed9-6792-48fd-b4d8-52d4bd0ea27e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5168c1a5-0e43-4340-9e71-9c7647d331eb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:53 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume 77d1ccd4-a012-46c5-89ec-20c44478a6a5: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5', 'volume_size': 1}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-429870d2-cd06-471b-82a9-aa6bb5b208f9" returned: 0 in 0.890s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] <== create_volume: return (1362ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.367s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.029s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1161945929',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77d1ccd4-a012-46c5-89ec-20c44478a6a5,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110928c19cd34d63a436b49cf36b2a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:52Z,use_quota=True,user_id='2f1bde229b014dba89a4fc01d11de39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Creating volume 77d1ccd4-a012-46c5-89ec-20c44478a6a5 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:46:53 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:53 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=142, name=volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:46:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Flow 'volume_create_manager' (427d05cf-819b-4987-9433-7bb41ab868ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d51ad31-4ff8-4ff7-9d81-6529b450a757) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (c7b11c92-be98-4419-9783-bc61849eaab0) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-429870d2-cd06-471b-82a9-aa6bb5b208f9', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f126b47-09e5-4c7f-a5de-36dfee2cf27a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Flow 'volume_create_manager' (26171b19-2101-4f31-a4e5-3c169d9c1deb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cff945c-f4fb-474f-847c-15ebd84de17e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Flow 'volume_create_manager' (ab346200-6791-4a06-9b90-66aa4f83b476) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e53566-c0c8-4bf9-8539-92264b211d13) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5 1073741824" returned: 0 in 0.617s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5d51ad31-4ff8-4ff7-9d81-6529b450a757) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-634947601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0839a988-f129-43f8-89fa-ae6c8e97e92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110928c19cd34d63a436b49cf36b2a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:53Z,use_quota=True,user_id='2f1bde229b014dba89a4fc01d11de39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2f3cb7-e398-46f0-94f3-189ad7bc392a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (bd2f3cb7-e398-46f0-94f3-189ad7bc392a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650a83a2-bd79-4222-a83d-9aff1869cb4f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (650a83a2-bd79-4222-a83d-9aff1869cb4f) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '0839a988-f129-43f8-89fa-ae6c8e97e92b', 'volume_name': 'volume-0839a988-f129-43f8-89fa-ae6c8e97e92b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e5da4f-7870-4ad4-be53-e60443a5f780) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (33e5da4f-7870-4ad4-be53-e60443a5f780) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59536f08-4cb5-4378-849b-1f362b6b66b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume 0839a988-f129-43f8-89fa-ae6c8e97e92b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-0839a988-f129-43f8-89fa-ae6c8e97e92b', 'volume_size': 1}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (4cff945c-f4fb-474f-847c-15ebd84de17e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1108785025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d155ce71-1a72-4f99-8cce-c8dd618e108c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110928c19cd34d63a436b49cf36b2a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:52Z,use_quota=True,user_id='2f1bde229b014dba89a4fc01d11de39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f4e4be-5fd5-47f6-bcc9-f708f9180f38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (a7f4e4be-5fd5-47f6-bcc9-f708f9180f38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcde05a-d093-4362-8ea5-3436ff631e0d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (0fcde05a-d093-4362-8ea5-3436ff631e0d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd155ce71-1a72-4f99-8cce-c8dd618e108c', 'volume_name': 'volume-d155ce71-1a72-4f99-8cce-c8dd618e108c', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91944c91-01ea-4ac1-aec7-4dbf20eb0472) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (91944c91-01ea-4ac1-aec7-4dbf20eb0472) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d686ffe9-fc87-414f-83c9-b1416c3f2062) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume d155ce71-1a72-4f99-8cce-c8dd618e108c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d155ce71-1a72-4f99-8cce-c8dd618e108c', 'volume_size': 1}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (e5e53566-c0c8-4bf9-8539-92264b211d13) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-840491708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ef008b-df3a-4c86-a071-42b0bbc2da6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110928c19cd34d63a436b49cf36b2a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:53Z,use_quota=True,user_id='2f1bde229b014dba89a4fc01d11de39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53c3433-c9d9-4488-9f61-846ee4d599c2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b53c3433-c9d9-4488-9f61-846ee4d599c2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78bfa51-44bc-41d8-8ca0-46d933ecbea5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f78bfa51-44bc-41d8-8ca0-46d933ecbea5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '67ef008b-df3a-4c86-a071-42b0bbc2da6f', 'volume_name': 'volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779b7082-5293-4836-86d1-9529511401f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (779b7082-5293-4836-86d1-9529511401f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f05a93a-f0e5-4d0b-8667-44d660288892) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume 67ef008b-df3a-4c86-a071-42b0bbc2da6f: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f', 'volume_size': 1}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:54 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume volume-429870d2-cd06-471b-82a9-aa6bb5b208f9 (429870d2-cd06-471b-82a9-aa6bb5b208f9): created successfully
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7f126b47-09e5-4c7f-a5de-36dfee2cf27a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Flow 'volume_create_manager' (69ad284c-e1e3-438b-bf49-258a5d3b79fd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5" returned: 0 in 0.533s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] <== create_volume: return (1178ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.184s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.170s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:53Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-634947601',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=0839a988-f129-43f8-89fa-ae6c8e97e92b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110928c19cd34d63a436b49cf36b2a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:53Z,use_quota=True,user_id='2f1bde229b014dba89a4fc01d11de39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Creating volume 0839a988-f129-43f8-89fa-ae6c8e97e92b {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:46:54 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0839a988-f129-43f8-89fa-ae6c8e97e92b 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:54 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-96493f53-ea74-4f30-9b06-5f0ac8791a50 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Created volume successfully.
Sep 24 18:46:54 devstack quobyte-client[84204]: System call of process 100108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:54 devstack quobyte-client[84204]: System call of process 100108 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:54 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=143, name=volume-0839a988-f129-43f8-89fa-ae6c8e97e92b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (5168c1a5-0e43-4340-9e71-9c7647d331eb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6840f8-71ca-422a-8d9b-c567e170eae6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:54 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5 (77d1ccd4-a012-46c5-89ec-20c44478a6a5): created successfully
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (7c6840f8-71ca-422a-8d9b-c567e170eae6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Flow 'volume_create_manager' (78560edd-75e8-4bbf-b14a-e83f6fdfc029) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0839a988-f129-43f8-89fa-ae6c8e97e92b 1073741824" returned: 0 in 0.418s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0839a988-f129-43f8-89fa-ae6c8e97e92b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:54 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e6349b4e-948e-4bde-9ff1-69ef3714cd7d tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Created volume successfully.
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0839a988-f129-43f8-89fa-ae6c8e97e92b" returned: 0 in 0.247s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] <== create_volume: return (689ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:46:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.701s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.855s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1108785025',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d155ce71-1a72-4f99-8cce-c8dd618e108c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110928c19cd34d63a436b49cf36b2a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:52Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:52Z,use_quota=True,user_id='2f1bde229b014dba89a4fc01d11de39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Creating volume d155ce71-1a72-4f99-8cce-c8dd618e108c {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:46:55 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d155ce71-1a72-4f99-8cce-c8dd618e108c 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:55 devstack quobyte-client[84204]: System call of process 100112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:55 devstack quobyte-client[84204]: System call of process 100112 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:55 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=144, name=volume-d155ce71-1a72-4f99-8cce-c8dd618e108c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (59536f08-4cb5-4378-849b-1f362b6b66b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-0839a988-f129-43f8-89fa-ae6c8e97e92b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181ff9b3-9e6d-4b83-be5e-5f4458ecb73b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:55 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume volume-0839a988-f129-43f8-89fa-ae6c8e97e92b (0839a988-f129-43f8-89fa-ae6c8e97e92b): created successfully
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (181ff9b3-9e6d-4b83-be5e-5f4458ecb73b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Flow 'volume_create_manager' (427d05cf-819b-4987-9433-7bb41ab868ed) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d155ce71-1a72-4f99-8cce-c8dd618e108c 1073741824" returned: 0 in 0.447s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d155ce71-1a72-4f99-8cce-c8dd618e108c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:55 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-0c72f766-415a-4d2f-9780-d9b1e220645e tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Created volume successfully.
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d155ce71-1a72-4f99-8cce-c8dd618e108c" returned: 0 in 0.245s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] <== create_volume: return (735ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.753s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.600s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:46:52Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-840491708',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=67ef008b-df3a-4c86-a071-42b0bbc2da6f,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='110928c19cd34d63a436b49cf36b2a89',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:46:53Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:46:53Z,use_quota=True,user_id='2f1bde229b014dba89a4fc01d11de39a',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Creating volume 67ef008b-df3a-4c86-a071-42b0bbc2da6f {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:46:55 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:46:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:55 devstack quobyte-client[84204]: System call of process 100116 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:55 devstack quobyte-client[84204]: System call of process 100116 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:55 devstack quobyte-client[84204]: System call of process 100116 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:55 devstack quobyte-client[84204]: System call of process 100116 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:46:56 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=145, name=volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d686ffe9-fc87-414f-83c9-b1416c3f2062) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d155ce71-1a72-4f99-8cce-c8dd618e108c', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b40c07-74de-4a26-a8e8-3c4ef39fd47b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:56 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume volume-d155ce71-1a72-4f99-8cce-c8dd618e108c (d155ce71-1a72-4f99-8cce-c8dd618e108c): created successfully
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (21b40c07-74de-4a26-a8e8-3c4ef39fd47b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Flow 'volume_create_manager' (26171b19-2101-4f31-a4e5-3c169d9c1deb) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f 1073741824" returned: 0 in 0.439s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:56 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-8d3f682f-5166-418c-8344-02a278aaebac tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Created volume successfully.
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f" returned: 0 in 0.253s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] <== create_volume: return (723ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.743s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (9f05a93a-f0e5-4d0b-8667-44d660288892) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0810187-1137-418b-98d1-88e91624ef8d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:46:56 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f (67ef008b-df3a-4c86-a071-42b0bbc2da6f): created successfully
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d0810187-1137-418b-98d1-88e91624ef8d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:46:56 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Flow 'volume_create_manager' (ab346200-6791-4a06-9b90-66aa4f83b476) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:46:56 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-fdcd16c6-9c79-465f-8722-591b7f762aec tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Created volume successfully.
Sep 24 18:46:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "cinder-0839a988-f129-43f8-89fa-ae6c8e97e92b-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-0839a988-f129-43f8-89fa-ae6c8e97e92b-delete_volume" acquired by "delete_volume" :: waited 0.088s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:57 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:46:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "cinder-quobyte-0839a988-f129-43f8-89fa-ae6c8e97e92b" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:46:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-quobyte-0839a988-f129-43f8-89fa-ae6c8e97e92b" acquired by "delete_volume" :: waited 0.013s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:46:57 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ff4308b8-e331-4182-babf-4b59503b8e9d]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:46:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0839a988-f129-43f8-89fa-ae6c8e97e92b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0839a988-f129-43f8-89fa-ae6c8e97e92b" returned: 0 in 0.410s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0839a988-f129-43f8-89fa-ae6c8e97e92b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-0839a988-f129-43f8-89fa-ae6c8e97e92b" returned: 0 in 0.107s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-quobyte-0839a988-f129-43f8-89fa-ae6c8e97e92b" released by "delete_volume" :: held 0.666s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:58 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Created reservations ['424cf93a-85a1-4501-89e6-ad73ded2d623', '13fc345e-41a2-4fc3-b808-01dbc52e9928', 'd0d82696-e1d1-4bb1-bc50-5b86d1436519', '933371ea-5273-49f4-8750-c6e40691778b'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:46:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:46:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:46:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:46:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:46:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:46:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:46:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.109s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:46:59 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:46:59 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Deleted volume successfully.
Sep 24 18:46:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9d276e98-e622-43a7-8d04-145ebc34a3d5 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-0839a988-f129-43f8-89fa-ae6c8e97e92b-delete_volume" released by "delete_volume" :: held 1.601s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:46:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "cinder-67ef008b-df3a-4c86-a071-42b0bbc2da6f-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-67ef008b-df3a-4c86-a071-42b0bbc2da6f-delete_volume" acquired by "delete_volume" :: waited 0.046s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:00 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "cinder-quobyte-67ef008b-df3a-4c86-a071-42b0bbc2da6f" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-quobyte-67ef008b-df3a-4c86-a071-42b0bbc2da6f" acquired by "delete_volume" :: waited 0.015s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:00 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[87014774-e2cf-49a2-87b3-55e4ebe6769c]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f" returned: 0 in 0.573s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-67ef008b-df3a-4c86-a071-42b0bbc2da6f" returned: 0 in 0.110s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-quobyte-67ef008b-df3a-4c86-a071-42b0bbc2da6f" released by "delete_volume" :: held 0.874s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:01 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Created reservations ['8dd144f4-c60b-4132-9593-747539d452f9', '3631aa32-26d0-4727-bcff-0147730fbafb', 'dba55e22-dc27-463b-9aa2-c98e46b0ed7e', '92c170bc-f9fc-407b-889d-d2eeb19aabcc'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:47:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:01 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.089s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:01 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:47:01 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Deleted volume successfully.
Sep 24 18:47:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-49214b0c-49b2-4aa6-abd2-0590abb35a3c tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-67ef008b-df3a-4c86-a071-42b0bbc2da6f-delete_volume" released by "delete_volume" :: held 1.877s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "cinder-d155ce71-1a72-4f99-8cce-c8dd618e108c-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-d155ce71-1a72-4f99-8cce-c8dd618e108c-delete_volume" acquired by "delete_volume" :: waited 0.029s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:02 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "cinder-quobyte-d155ce71-1a72-4f99-8cce-c8dd618e108c" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-quobyte-d155ce71-1a72-4f99-8cce-c8dd618e108c" acquired by "delete_volume" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:02 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[161d46e8-3c4a-4be2-a8bd-67b36823f255]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d155ce71-1a72-4f99-8cce-c8dd618e108c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d155ce71-1a72-4f99-8cce-c8dd618e108c" returned: 0 in 0.445s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d155ce71-1a72-4f99-8cce-c8dd618e108c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d155ce71-1a72-4f99-8cce-c8dd618e108c" returned: 0 in 0.110s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-quobyte-d155ce71-1a72-4f99-8cce-c8dd618e108c" released by "delete_volume" :: held 0.706s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:03 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Created reservations ['2689d67b-a3d6-4b6d-a602-7005af68e0a4', '0e6d02f3-e9de-4ee4-aa82-5c65158f0d85', '8543f2fa-b2f4-415c-9ec4-e1477ce845b6', 'c1eb35e4-19d6-473a-a788-97aa2155a738'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:47:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.085s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:03 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:47:03 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Deleted volume successfully.
Sep 24 18:47:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-04598f53-85e5-4076-8d76-5dbf0c5f1288 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-d155ce71-1a72-4f99-8cce-c8dd618e108c-delete_volume" released by "delete_volume" :: held 1.649s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "cinder-77d1ccd4-a012-46c5-89ec-20c44478a6a5-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-77d1ccd4-a012-46c5-89ec-20c44478a6a5-delete_volume" acquired by "delete_volume" :: waited 0.048s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:04 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "cinder-quobyte-77d1ccd4-a012-46c5-89ec-20c44478a6a5" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-quobyte-77d1ccd4-a012-46c5-89ec-20c44478a6a5" acquired by "delete_volume" :: waited 0.016s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:04 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3adac3f8-24fd-456d-9add-cdd523d2dd24]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5" returned: 0 in 0.389s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77d1ccd4-a012-46c5-89ec-20c44478a6a5" returned: 0 in 0.115s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-quobyte-77d1ccd4-a012-46c5-89ec-20c44478a6a5" released by "delete_volume" :: held 0.653s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Created reservations ['36963225-9ede-4019-89a6-3a9a78603e16', '932dcd64-6b26-4f3c-97ec-0aedc8ce7702', 'dc25e485-ba8e-40f3-9558-633bfa9c7939', '5a6eac03-45ce-4238-b0ab-0ba5c64826a1'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.108s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:05 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:47:06 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Deleted volume successfully.
Sep 24 18:47:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-b03e5442-e10e-4226-8dcb-ee57d636c5ae tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-77d1ccd4-a012-46c5-89ec-20c44478a6a5-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "cinder-429870d2-cd06-471b-82a9-aa6bb5b208f9-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-429870d2-cd06-471b-82a9-aa6bb5b208f9-delete_volume" acquired by "delete_volume" :: waited 0.039s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:07 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "cinder-quobyte-429870d2-cd06-471b-82a9-aa6bb5b208f9" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-quobyte-429870d2-cd06-471b-82a9-aa6bb5b208f9" acquired by "delete_volume" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:07 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[68514b94-73f7-4886-8681-2b52ed097efe]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-429870d2-cd06-471b-82a9-aa6bb5b208f9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-429870d2-cd06-471b-82a9-aa6bb5b208f9" returned: 0 in 0.417s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-429870d2-cd06-471b-82a9-aa6bb5b208f9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-429870d2-cd06-471b-82a9-aa6bb5b208f9" returned: 0 in 0.106s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:07 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-quobyte-429870d2-cd06-471b-82a9-aa6bb5b208f9" released by "delete_volume" :: held 0.676s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:07 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Created reservations ['c1f8b1c8-449e-4d71-8614-663b219cd73e', '88c9e171-afef-4d13-9821-117a6470e79b', 'a9428384-8154-48c1-b497-24844fc96ff8', 'c247195d-9d9b-4341-8e2d-fa19cecabadc'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:47:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.080s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:08 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:47:08 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Deleted volume successfully.
Sep 24 18:47:08 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a0886cfb-b06a-4568-8606-6f87114edf57 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-429870d2-cd06-471b-82a9-aa6bb5b208f9-delete_volume" released by "delete_volume" :: held 1.592s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "cinder-f50498ff-3484-414f-b5ee-3c5d2880874b-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-f50498ff-3484-414f-b5ee-3c5d2880874b-delete_volume" acquired by "delete_volume" :: waited 0.037s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:09 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "cinder-quobyte-f50498ff-3484-414f-b5ee-3c5d2880874b" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-quobyte-f50498ff-3484-414f-b5ee-3c5d2880874b" acquired by "delete_volume" :: waited 0.010s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:09 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[60dedc13-1339-4bf8-918a-29a9916c7a78]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f50498ff-3484-414f-b5ee-3c5d2880874b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f50498ff-3484-414f-b5ee-3c5d2880874b" returned: 0 in 0.394s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f50498ff-3484-414f-b5ee-3c5d2880874b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f50498ff-3484-414f-b5ee-3c5d2880874b" returned: 0 in 0.103s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:09 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-quobyte-f50498ff-3484-414f-b5ee-3c5d2880874b" released by "delete_volume" :: held 0.639s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:10 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Created reservations ['d697458d-30e9-446b-9df4-626ca6dec854', '73c7e57e-f6aa-438b-8604-6e8e506444e0', '1127ba43-fd9c-4b3b-aeec-5caf6a6c431a', '5f0c4992-b336-49f6-852e-969c7cfe46eb'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:47:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.109s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:10 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:47:10 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Deleted volume successfully.
Sep 24 18:47:10 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-eed2b1d0-f05a-4106-b70c-0f159f5dae23 tempest-CreateVolumesFromSourceVolumeTest-688004403 None] Lock "cinder-f50498ff-3484-414f-b5ee-3c5d2880874b-delete_volume" released by "delete_volume" :: held 1.525s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:47:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.127s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:12 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:47:20 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=113,cinder:SELECT=56,cinder:DELETE=5,cinder:INSERT=22 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:47:20 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=76,cinder:UPDATE=107,cinder:DELETE=17,cinder:INSERT=22 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:47:29 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Flow 'volume_create_manager' (778ec74e-38e9-4799-acbe-1fc943541a8a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69abebc6-8ea8-4f42-b721-caf85577cc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (69abebc6-8ea8-4f42-b721-caf85577cc1d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-942744554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b286e088-9bad-43ef-8cea-a0266110914d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61147834c7e64b149691e49af95c73fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:29Z,use_quota=True,user_id='93f23800ab7e4f3299a91c19bd5d510f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50cc66a-ed21-4336-befe-534637bed42d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c50cc66a-ed21-4336-befe-534637bed42d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abef749c-f16c-47bc-85c1-0e201b37fa5c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (abef749c-f16c-47bc-85c1-0e201b37fa5c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b286e088-9bad-43ef-8cea-a0266110914d', 'volume_name': 'volume-b286e088-9bad-43ef-8cea-a0266110914d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a95e486-9148-44f6-a597-1ec815d7655a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9a95e486-9148-44f6-a597-1ec815d7655a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab2bf95-68c9-4e05-8779-f122801cb041) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:29 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Volume b286e088-9bad-43ef-8cea-a0266110914d: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b286e088-9bad-43ef-8cea-a0266110914d', 'volume_size': 1}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:29Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-942744554',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b286e088-9bad-43ef-8cea-a0266110914d,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61147834c7e64b149691e49af95c73fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:29Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:29Z,use_quota=True,user_id='93f23800ab7e4f3299a91c19bd5d510f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Creating volume b286e088-9bad-43ef-8cea-a0266110914d {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:47:29 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:47:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b286e088-9bad-43ef-8cea-a0266110914d 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:29 devstack quobyte-client[84204]: System call of process 100239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:29 devstack quobyte-client[84204]: System call of process 100239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:29 devstack quobyte-client[84204]: System call of process 100239 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:29 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=146, name=volume-b286e088-9bad-43ef-8cea-a0266110914d, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:47:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b286e088-9bad-43ef-8cea-a0266110914d 1073741824" returned: 0 in 0.915s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b286e088-9bad-43ef-8cea-a0266110914d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:30 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:30 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Flow 'volume_create_manager' (81c885e8-0808-4522-842a-752a12c9ae67) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450ed47d-9763-4efe-acec-5cdb73a7413d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (450ed47d-9763-4efe-acec-5cdb73a7413d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1594910605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e682c285-a77d-4195-89a2-e6820b09f576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61147834c7e64b149691e49af95c73fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:30Z,use_quota=True,user_id='93f23800ab7e4f3299a91c19bd5d510f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e93f16-aef9-42d1-8c4b-0610fe790eb5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (62e93f16-aef9-42d1-8c4b-0610fe790eb5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90f2ea1-1a60-46f4-9c11-491f1672535b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d90f2ea1-1a60-46f4-9c11-491f1672535b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'e682c285-a77d-4195-89a2-e6820b09f576', 'volume_name': 'volume-e682c285-a77d-4195-89a2-e6820b09f576', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03411c9-4521-4d3b-81eb-e918081224b6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f03411c9-4521-4d3b-81eb-e918081224b6) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cc76ea-c833-422f-839b-541a89c46a2e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:31 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Volume e682c285-a77d-4195-89a2-e6820b09f576: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-e682c285-a77d-4195-89a2-e6820b09f576', 'volume_size': 1}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b286e088-9bad-43ef-8cea-a0266110914d" returned: 0 in 0.855s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] <== create_volume: return (1887ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.897s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.125s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1594910605',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=e682c285-a77d-4195-89a2-e6820b09f576,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61147834c7e64b149691e49af95c73fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:30Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:30Z,use_quota=True,user_id='93f23800ab7e4f3299a91c19bd5d510f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Creating volume e682c285-a77d-4195-89a2-e6820b09f576 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:47:31 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e682c285-a77d-4195-89a2-e6820b09f576 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:31 devstack quobyte-client[84204]: System call of process 100245 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:31 devstack quobyte-client[84204]: System call of process 100245 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:31 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=147, name=volume-e682c285-a77d-4195-89a2-e6820b09f576, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:47:31 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:31 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Flow 'volume_create_manager' (7eac5963-db2f-4f40-bcde-e4f93f56813c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a17231d-1c04-42cd-ba14-a4bb7ede11b4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (dab2bf95-68c9-4e05-8779-f122801cb041) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b286e088-9bad-43ef-8cea-a0266110914d', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0cb6028-1ca3-41ed-a865-bcd1b3a5dcd8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5a17231d-1c04-42cd-ba14-a4bb7ede11b4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1186517711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186421a6-4165-4ada-866a-aab26554b548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61147834c7e64b149691e49af95c73fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:31Z,use_quota=True,user_id='93f23800ab7e4f3299a91c19bd5d510f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87414082-e93b-46cc-b4cc-4391005a45c3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (87414082-e93b-46cc-b4cc-4391005a45c3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98776aa-5e6d-4d38-b314-07036c884eaf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (d98776aa-5e6d-4d38-b314-07036c884eaf) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '186421a6-4165-4ada-866a-aab26554b548', 'volume_name': 'volume-186421a6-4165-4ada-866a-aab26554b548', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee59516e-b2f2-4587-bf24-75c144c05f9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ee59516e-b2f2-4587-bf24-75c144c05f9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c75c188-5030-4be0-a0a8-0fc9913d9d81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:32 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Volume 186421a6-4165-4ada-866a-aab26554b548: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-186421a6-4165-4ada-866a-aab26554b548', 'volume_size': 1}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e682c285-a77d-4195-89a2-e6820b09f576 1073741824" returned: 0 in 0.893s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:32 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Volume volume-b286e088-9bad-43ef-8cea-a0266110914d (b286e088-9bad-43ef-8cea-a0266110914d): created successfully
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e0cb6028-1ca3-41ed-a865-bcd1b3a5dcd8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Flow 'volume_create_manager' (778ec74e-38e9-4799-acbe-1fc943541a8a) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:32 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Flow 'volume_create_manager' (23ce31f0-b6d5-4332-b776-1112cefc8f94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe769d8-9715-416d-ab1d-779947359d32) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e682c285-a77d-4195-89a2-e6820b09f576 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:32 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Flow 'volume_create_manager' (4aa64195-a362-4357-a764-751ab63c06f8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a90fd0-626d-4483-93a2-492f778c389a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:33 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-cf53cb62-9a67-4e3a-aee1-3e0f61214fdc tempest-CreateVolumesFromImageTest-339045108 None] Created volume successfully.
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (fbe769d8-9715-416d-ab1d-779947359d32) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-705740545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3785d37d-c88c-4311-a58c-4fd315ba9892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61147834c7e64b149691e49af95c73fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:31Z,use_quota=True,user_id='93f23800ab7e4f3299a91c19bd5d510f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc58cf2c-47c9-40c6-8c3a-65b847b533f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (dc58cf2c-47c9-40c6-8c3a-65b847b533f1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce5cba0-94f0-402b-b7b8-d78bf30a4ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (7ce5cba0-94f0-402b-b7b8-d78bf30a4ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '3785d37d-c88c-4311-a58c-4fd315ba9892', 'volume_name': 'volume-3785d37d-c88c-4311-a58c-4fd315ba9892', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75673b6d-d2bf-4564-9fa5-54e87521be77) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (75673b6d-d2bf-4564-9fa5-54e87521be77) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef584144-7186-4836-9ba5-235bebbf2829) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:33 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Volume 3785d37d-c88c-4311-a58c-4fd315ba9892: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-3785d37d-c88c-4311-a58c-4fd315ba9892', 'volume_size': 1}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e682c285-a77d-4195-89a2-e6820b09f576" returned: 0 in 0.693s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] <== create_volume: return (1698ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.704s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.797s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:30Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1186517711',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=186421a6-4165-4ada-866a-aab26554b548,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61147834c7e64b149691e49af95c73fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:31Z,use_quota=True,user_id='93f23800ab7e4f3299a91c19bd5d510f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Creating volume 186421a6-4165-4ada-866a-aab26554b548 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:47:33 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186421a6-4165-4ada-866a-aab26554b548 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:33 devstack quobyte-client[84204]: System call of process 100249 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:33 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=148, name=volume-186421a6-4165-4ada-866a-aab26554b548, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (11a90fd0-626d-4483-93a2-492f778c389a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1225827539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7254826d-a16a-4dbb-aea3-f5fc73ea7ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61147834c7e64b149691e49af95c73fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:32Z,use_quota=True,user_id='93f23800ab7e4f3299a91c19bd5d510f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca92df57-3a65-4f25-be81-d32274ea1c3a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ca92df57-3a65-4f25-be81-d32274ea1c3a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd01037b-f697-4672-bb1c-80961dc1aa06) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (bd01037b-f697-4672-bb1c-80961dc1aa06) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '7254826d-a16a-4dbb-aea3-f5fc73ea7ccb', 'volume_name': 'volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ac96b4-56a6-4d4a-8512-8877c8003b75) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (36ac96b4-56a6-4d4a-8512-8877c8003b75) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b00d042-180f-4f0f-9f62-1a61926f026d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:33 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Volume 7254826d-a16a-4dbb-aea3-f5fc73ea7ccb: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb', 'volume_size': 1}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (84cc76ea-c833-422f-839b-541a89c46a2e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-e682c285-a77d-4195-89a2-e6820b09f576', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:33 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9157301a-e7eb-4228-b729-d416f5e81488) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:34 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Volume volume-e682c285-a77d-4195-89a2-e6820b09f576 (e682c285-a77d-4195-89a2-e6820b09f576): created successfully
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9157301a-e7eb-4228-b729-d416f5e81488) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Flow 'volume_create_manager' (81c885e8-0808-4522-842a-752a12c9ae67) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:34 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Flow 'volume_create_manager' (6a8952d7-ed7c-4617-91cc-909a7bf14511) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2873d598-65af-4ac6-b8c3-0cbfbc294867) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186421a6-4165-4ada-866a-aab26554b548 1073741824" returned: 0 in 0.881s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (2873d598-65af-4ac6-b8c3-0cbfbc294867) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73502f65-f45f-43f6-8626-9fdfabb4a053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e160f5b2e43b4c0ab41819f4d31bd89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:34Z,use_quota=True,user_id='2b571660c10c4ff489b6dec266d426db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7262eeb5-6698-45b5-806a-7d1b61a2f17c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7262eeb5-6698-45b5-806a-7d1b61a2f17c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e595bd-bfa0-4272-90ab-75047241ba94) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.image.glance [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Creating Keystone auth plugin from conf {{(pid=84177) _create_glance_client /opt/stack/cinder/cinder/image/glance.py:128}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186421a6-4165-4ada-866a-aab26554b548 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:34 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1c43d4fe-700a-4830-9e73-af165330deda tempest-CreateVolumesFromImageTest-339045108 None] Created volume successfully.
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186421a6-4165-4ada-866a-aab26554b548" returned: 0 in 0.295s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] <== create_volume: return (1287ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.302s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.444s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:31Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-705740545',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=3785d37d-c88c-4311-a58c-4fd315ba9892,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61147834c7e64b149691e49af95c73fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:31Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:31Z,use_quota=True,user_id='93f23800ab7e4f3299a91c19bd5d510f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Creating volume 3785d37d-c88c-4311-a58c-4fd315ba9892 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:47:34 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:47:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3785d37d-c88c-4311-a58c-4fd315ba9892 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:34 devstack quobyte-client[84204]: System call of process 100255 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:34 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=149, name=volume-3785d37d-c88c-4311-a58c-4fd315ba9892, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0c75c188-5030-4be0-a0a8-0fc9913d9d81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-186421a6-4165-4ada-866a-aab26554b548', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dfb5ea9-95e3-4698-aa21-4fe282cab508) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:35 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Volume volume-186421a6-4165-4ada-866a-aab26554b548 (186421a6-4165-4ada-866a-aab26554b548): created successfully
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8dfb5ea9-95e3-4698-aa21-4fe282cab508) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Flow 'volume_create_manager' (7eac5963-db2f-4f40-bcde-e4f93f56813c) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3785d37d-c88c-4311-a58c-4fd315ba9892 1073741824" returned: 0 in 0.558s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3785d37d-c88c-4311-a58c-4fd315ba9892 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:35 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d03cf6ba-d3d6-4085-99dd-fb9c2e4a92ff tempest-CreateVolumesFromImageTest-339045108 None] Created volume successfully.
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3785d37d-c88c-4311-a58c-4fd315ba9892" returned: 0 in 0.497s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] <== create_volume: return (1082ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.098s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.943s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:32Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromImageTest-Volume-1225827539',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=7254826d-a16a-4dbb-aea3-f5fc73ea7ccb,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='61147834c7e64b149691e49af95c73fd',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:32Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:32Z,use_quota=True,user_id='93f23800ab7e4f3299a91c19bd5d510f',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Creating volume 7254826d-a16a-4dbb-aea3-f5fc73ea7ccb {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:47:35 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:47:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:36 devstack quobyte-client[84204]: System call of process 100259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:36 devstack quobyte-client[84204]: System call of process 100259 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:36 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=150, name=volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:47:36 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ef584144-7186-4836-9ba5-235bebbf2829) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-3785d37d-c88c-4311-a58c-4fd315ba9892', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:36 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6458214b-1c91-446a-840c-f86ad7f1f521) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:36 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (00e595bd-bfa0-4272-90ab-75047241ba94) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'image', 'volume_id': '73502f65-f45f-43f6-8626-9fdfabb4a053', 'volume_name': 'volume-73502f65-f45f-43f6-8626-9fdfabb4a053', 'volume_size': 1, 'image_id': '6c8f8a14-82d9-4940-bc62-063af3374684', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c8f8a14-82d9-4940-bc62-063af3374684', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c600970be6bbe68b6db2acc461c31601', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e160f5b2e43b4c0ab41819f4d31bd89e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aaeb410cfa9e6a0c7cd3d1fdee66326b1c59f6c4c42126d6ea2335f0bb7060bc83eece73a695bc41c852ce8cd22b328d44978947399b956d6a60b399093118d6', 'id': '6c8f8a14-82d9-4940-bc62-063af3374684', 'created_at': datetime.datetime(2025, 9, 24, 16, 47, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c8f8a14-82d9-4940-bc62-063af3374684/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029b63f40>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:36 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8f6127-b72f-454a-83c3-0653caf5eff0) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:36 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (6a8f6127-b72f-454a-83c3-0653caf5eff0) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:36 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da032676-718a-4f59-9111-bcd5e39ee626) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:36 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Volume 73502f65-f45f-43f6-8626-9fdfabb4a053: being created as image with specification: {'status': 'creating', 'volume_name': 'volume-73502f65-f45f-43f6-8626-9fdfabb4a053', 'volume_size': 1, 'image_id': '6c8f8a14-82d9-4940-bc62-063af3374684', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c8f8a14-82d9-4940-bc62-063af3374684', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c600970be6bbe68b6db2acc461c31601', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e160f5b2e43b4c0ab41819f4d31bd89e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aaeb410cfa9e6a0c7cd3d1fdee66326b1c59f6c4c42126d6ea2335f0bb7060bc83eece73a695bc41c852ce8cd22b328d44978947399b956d6a60b399093118d6', 'id': '6c8f8a14-82d9-4940-bc62-063af3374684', 'created_at': datetime.datetime(2025, 9, 24, 16, 47, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c8f8a14-82d9-4940-bc62-063af3374684/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029b63f40>}
Sep 24 18:47:36 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Cloning 73502f65-f45f-43f6-8626-9fdfabb4a053 from image 6c8f8a14-82d9-4940-bc62-063af3374684  at location (None, [{'url': 'file:///opt/stack/data/glance/images/6c8f8a14-82d9-4940-bc62-063af3374684', 'metadata': {}}]). {{(pid=84177) _create_from_image /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1085}}
Sep 24 18:47:36 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Volume volume-3785d37d-c88c-4311-a58c-4fd315ba9892 (3785d37d-c88c-4311-a58c-4fd315ba9892): created successfully
Sep 24 18:47:36 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6458214b-1c91-446a-840c-f86ad7f1f521) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:36 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Flow 'volume_create_manager' (23ce31f0-b6d5-4332-b776-1112cefc8f94) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb 1073741824" returned: 0 in 0.630s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:36 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b179964d-143f-42b4-8ba9-efaae7fa73a4 tempest-CreateVolumesFromImageTest-339045108 None] Created volume successfully.
Sep 24 18:47:36 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Image fetch details: dest /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:700}}
Sep 24 18:47:36 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Image download 0.00 MB at 0.00 MB/s
Sep 24 18:47:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb" returned: 0 in 0.520s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:37 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] <== create_volume: return (1181ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:47:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.197s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b00d042-180f-4f0f-9f62-1a61926f026d) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4142a4-96fd-40ff-8725-016dd95daa93) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:37 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cd29d07-9d24-4877-9bb0-a2c750592e68]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:37 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Volume volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb (7254826d-a16a-4dbb-aea3-f5fc73ea7ccb): created successfully
Sep 24 18:47:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (9d4142a4-96fd-40ff-8725-016dd95daa93) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:37 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Flow 'volume_create_manager' (4aa64195-a362-4357-a764-751ab63c06f8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:37 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e892a14b-4d30-4b61-96c7-79abee8686ec tempest-CreateVolumesFromImageTest-339045108 None] Created volume successfully.
Sep 24 18:47:38 devstack sudo[100263]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD
Sep 24 18:47:38 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "cinder-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:38 devstack sudo[100263]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:47:38 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb-delete_volume" acquired by "delete_volume" :: waited 0.136s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:38 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:38 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "cinder-quobyte-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:38 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-quobyte-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb" acquired by "delete_volume" :: waited 0.023s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:38 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7cc439ad-7188-4460-957f-72062b094447]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb" returned: 0 in 0.809s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:39 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb" returned: 0 in 0.135s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:39 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-quobyte-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb" released by "delete_volume" :: held 1.224s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:40 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Created reservations ['f876a140-4035-49db-abd0-d8cdcfddb4a5', 'b90c83fd-c0d9-4e8b-841f-e0af17a221ca', 'f382897f-5711-4fd2-b081-75d7d4189600', '1eae2ddf-0a03-46c0-b681-255c80e54c71'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:47:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:40 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:40 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:40 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:40 devstack sudo[100263]: pam_unix(sudo:session): session closed for user root
Sep 24 18:47:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD" returned: 0 in 3.796s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:41 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.511s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:41 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:47:41 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Deleted volume successfully.
Sep 24 18:47:41 devstack sudo[100272]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD
Sep 24 18:47:41 devstack sudo[100272]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:47:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "cinder-3785d37d-c88c-4311-a58c-4fd315ba9892-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-da481fad-3854-4b94-b2b5-a7e6ff7f417f tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-7254826d-a16a-4dbb-aea3-f5fc73ea7ccb-delete_volume" released by "delete_volume" :: held 3.820s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-3785d37d-c88c-4311-a58c-4fd315ba9892-delete_volume" acquired by "delete_volume" :: waited 0.156s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:42 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "cinder-quobyte-3785d37d-c88c-4311-a58c-4fd315ba9892" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:42 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-quobyte-3785d37d-c88c-4311-a58c-4fd315ba9892" acquired by "delete_volume" :: waited 0.041s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:42 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d66b99de-a244-487a-a3e7-246ff834a4e7]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:42 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3785d37d-c88c-4311-a58c-4fd315ba9892 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:43 devstack quobyte-client[84204]: System call of process 100275 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3785d37d-c88c-4311-a58c-4fd315ba9892" returned: 0 in 0.641s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3785d37d-c88c-4311-a58c-4fd315ba9892 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-3785d37d-c88c-4311-a58c-4fd315ba9892" returned: 0 in 0.269s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:43 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-quobyte-3785d37d-c88c-4311-a58c-4fd315ba9892" released by "delete_volume" :: held 1.225s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:44 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Created reservations ['c85aeb20-dc1c-4115-9b2b-7c71f6ae5c86', '13713b14-0f19-4635-ab45-bb1aeaaa2594', 'fb2a7a24-87e5-4016-bc08-1d0b24f7e890', '6396f8cd-5716-4567-94a2-8c76276cf1dc'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:47:44 devstack sudo[100272]: pam_unix(sudo:session): session closed for user root
Sep 24 18:47:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD" returned: 1 in 3.541s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:47:44 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Temporary image 6c8f8a14-82d9-4940-bc62-063af3374684 is fetched for user 2b571660c10c4ff489b6dec266d426db. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1399}}
Sep 24 18:47:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.038s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.465s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:45 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:47:45 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Deleted volume successfully.
Sep 24 18:47:45 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c3f819fb-e396-4c3c-8259-ea674090f6d6]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:45 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-9f84fbfe-3f09-40c4-8241-8617b5d7e6fb tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-3785d37d-c88c-4311-a58c-4fd315ba9892-delete_volume" released by "delete_volume" :: held 3.433s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "cinder-186421a6-4165-4ada-866a-aab26554b548-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:45 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-186421a6-4165-4ada-866a-aab26554b548-delete_volume" acquired by "delete_volume" :: waited 0.045s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:46 devstack sudo[100283]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD
Sep 24 18:47:46 devstack sudo[100283]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:47:46 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "cinder-quobyte-186421a6-4165-4ada-866a-aab26554b548" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:46 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-quobyte-186421a6-4165-4ada-866a-aab26554b548" acquired by "delete_volume" :: waited 0.015s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:46 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[82caa3d3-3cf2-4232-9eac-5ff1f094423b]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186421a6-4165-4ada-866a-aab26554b548 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:46 devstack quobyte-client[84204]: System call of process 100285 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186421a6-4165-4ada-866a-aab26554b548" returned: 0 in 0.773s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186421a6-4165-4ada-866a-aab26554b548 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-186421a6-4165-4ada-866a-aab26554b548" returned: 0 in 0.144s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:47 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-quobyte-186421a6-4165-4ada-866a-aab26554b548" released by "delete_volume" :: held 1.190s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:47 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Created reservations ['b5e0c08c-11bc-4cff-93ad-09613e7f3d4b', '6d5257b1-a6b0-4fdd-a64a-f4cdbe4c4a67', '849b3fc9-b125-46d6-9645-ecac2fafb690', '3ad8b0a6-db1d-49da-bdfe-2b29f71d0de0'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:47:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.146s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:48 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:47:48 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Deleted volume successfully.
Sep 24 18:47:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "cinder-e682c285-a77d-4195-89a2-e6820b09f576-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-e682c285-a77d-4195-89a2-e6820b09f576-delete_volume" acquired by "delete_volume" :: waited 0.100s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c1eddbbb-93c2-4fbb-9de3-62a3f4a8b506 tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-186421a6-4165-4ada-866a-aab26554b548-delete_volume" released by "delete_volume" :: held 2.872s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:48 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "cinder-quobyte-e682c285-a77d-4195-89a2-e6820b09f576" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:48 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-quobyte-e682c285-a77d-4195-89a2-e6820b09f576" acquired by "delete_volume" :: waited 0.013s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:48 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3206f030-6f6d-419b-8c5a-6c7c71c84b64]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e682c285-a77d-4195-89a2-e6820b09f576 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:49 devstack sudo[100283]: pam_unix(sudo:session): session closed for user root
Sep 24 18:47:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD" returned: 0 in 3.855s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:49 devstack quobyte-client[84204]: System call of process 100292 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:49 devstack sudo[100293]:  quobyte : PWD=/ ; USER=root ; COMMAND=/opt/stack/data/venv/bin/cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD
Sep 24 18:47:49 devstack sudo[100293]: pam_unix(sudo:session): session opened for user root(uid=0) by (uid=1000)
Sep 24 18:47:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e682c285-a77d-4195-89a2-e6820b09f576" returned: 0 in 0.839s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e682c285-a77d-4195-89a2-e6820b09f576 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-e682c285-a77d-4195-89a2-e6820b09f576" returned: 0 in 0.167s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:50 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-quobyte-e682c285-a77d-4195-89a2-e6820b09f576" released by "delete_volume" :: held 1.266s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:50 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Created reservations ['407e768f-ceb8-49f0-a39a-327f31f5e4f9', '233f72f2-eb11-40e0-97e7-c08a6b88a833', '7df501c8-e9b6-434d-a782-3400d82e9ac9', 'a8607ec4-2ba9-4437-985b-e4c57ae3736c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:47:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.181s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:50 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:47:51 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Deleted volume successfully.
Sep 24 18:47:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-11c6846b-2c06-44e1-848c-767772adbef0 tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-e682c285-a77d-4195-89a2-e6820b09f576-delete_volume" released by "delete_volume" :: held 2.754s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "cinder-b286e088-9bad-43ef-8cea-a0266110914d-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:51 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-b286e088-9bad-43ef-8cea-a0266110914d-delete_volume" acquired by "delete_volume" :: waited 0.082s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:52 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "cinder-quobyte-b286e088-9bad-43ef-8cea-a0266110914d" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:47:52 devstack sudo[100293]: pam_unix(sudo:session): session closed for user root
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD" returned: 1 in 3.002s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- sudo cinder-rootwrap /etc/cinder/rootwrap.conf env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:34Z,deleted=False,deleted_at=None,display_description=None,display_name='volume1-for-test7a9fba78-2e4b-42b1-9898-bb4a60685320',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=73502f65-f45f-43f6-8626-9fdfabb4a053,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='e160f5b2e43b4c0ab41819f4d31bd89e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:34Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:34Z,use_quota=True,user_id='2b571660c10c4ff489b6dec266d426db',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Creating volume 73502f65-f45f-43f6-8626-9fdfabb4a053 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:47:52 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:52 devstack quobyte-client[84204]: System call of process 100303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-quobyte-b286e088-9bad-43ef-8cea-a0266110914d" acquired by "delete_volume" :: waited 0.168s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:47:52 devstack quobyte-client[84204]: System call of process 100303 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:52 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=151, name=volume-73502f65-f45f-43f6-8626-9fdfabb4a053, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[f9e9d694-a4c7-4e4a-881a-71740f4bd2c5]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b286e088-9bad-43ef-8cea-a0266110914d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053 1073741824" returned: 0 in 0.454s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053" returned: 0 in 0.114s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] <== create_volume: return (660ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:47:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.696s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b286e088-9bad-43ef-8cea-a0266110914d" returned: 0 in 0.784s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b286e088-9bad-43ef-8cea-a0266110914d {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b286e088-9bad-43ef-8cea-a0266110914d" returned: 0 in 0.186s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:53 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Attempting download of 6c8f8a14-82d9-4940-bc62-063af3374684 ((None, [{'url': 'file:///opt/stack/data/glance/images/6c8f8a14-82d9-4940-bc62-063af3374684', 'metadata': {}}])) to volume 73502f65-f45f-43f6-8626-9fdfabb4a053. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1184}}
Sep 24 18:47:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-quobyte-b286e088-9bad-43ef-8cea-a0266110914d" released by "delete_volume" :: held 1.303s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:53 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[67d7d743-1b72-4515-b487-b5189c758580]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c8f8a14-82d9-4940-bc62-063af3374684_fmmz2gox {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:54 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Created reservations ['3fecc4d9-0e3e-46bb-9d0b-b7e4d37e5047', '31bb94c1-8217-4802-b25b-176b7f4f8d43', '5176abe2-a4b5-479e-9c9b-6d818fb3926f', '7f26bd87-2483-419a-9ac8-b018cf7cb77c'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:47:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.026s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_download_6c8f8a14-82d9-4940-bc62-063af3374684_fmmz2gox" returned: 0 in 0.720s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c8f8a14-82d9-4940-bc62-063af3374684_fmmz2gox {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.178s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:54 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:47:54 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Deleted volume successfully.
Sep 24 18:47:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5691c0b3-1681-475f-87f6-e5675d9c82a3 tempest-CreateVolumesFromImageTest-339045108 None] Lock "cinder-b286e088-9bad-43ef-8cea-a0266110914d-delete_volume" released by "delete_volume" :: held 3.070s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:47:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c8f8a14-82d9-4940-bc62-063af3374684_fmmz2gox" returned: 1 in 0.532s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_download_6c8f8a14-82d9-4940-bc62-063af3374684_fmmz2gox' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:47:55 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a558c5e-ef10-44ca-9117-5d1104da88a2]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD" returned: 0 in 0.645s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD" returned: 1 in 0.438s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:47:56 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] 6c8f8a14-82d9-4940-bc62-063af3374684 was raw, converting to raw {{(pid=84177) fetch_to_volume_format /opt/stack/cinder/cinder/image/image_utils.py:1088}}
Sep 24 18:47:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:56 devstack quobyte-client[84204]: System call of process 100321 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:47:56 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=151, name=volume-73502f65-f45f-43f6-8626-9fdfabb4a053, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:47:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "qemu-img convert -O raw -f raw /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053" returned: 0 in 0.331s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:56 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Image conversion details: src /opt/stack/data/cinder/conversion/image_fetch_6c8f8a14-82d9-4940-bc62-063af3374684_jtde67zodevstack@QuobyteHD, size 0.00 MB, duration 1.00 sec, destination /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053 {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:47:56 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Converted 0.00 MB image at 0.00 MB/s
Sep 24 18:47:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "qemu-img resize /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053 1G" returned: 0 in 0.173s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:57 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[01c2d13d-9b42-4728-9137-40f3a4ce6952]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:47:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053" returned: 0 in 0.489s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:47:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053" returned: 1 in 0.474s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:47:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:47:58 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Downloaded image 6c8f8a14-82d9-4940-bc62-063af3374684 ((None, [{'url': 'file:///opt/stack/data/glance/images/6c8f8a14-82d9-4940-bc62-063af3374684', 'metadata': {}}])) to volume 73502f65-f45f-43f6-8626-9fdfabb4a053 successfully. {{(pid=84177) copy_image_to_volume /opt/stack/cinder/cinder/volume/volume_utils.py:1229}}
Sep 24 18:47:58 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Temporary image 6c8f8a14-82d9-4940-bc62-063af3374684 for user 2b571660c10c4ff489b6dec266d426db is deleted. {{(pid=84177) fetch /opt/stack/cinder/cinder/image/image_utils.py:1403}}
Sep 24 18:47:58 devstack cinder-volume[84177]: DEBUG cinder.volume.volume_utils [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Marking volume 73502f65-f45f-43f6-8626-9fdfabb4a053 as bootable. {{(pid=84177) enable_bootable_flag /opt/stack/cinder/cinder/volume/volume_utils.py:1133}}
Sep 24 18:47:58 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Copying metadata from image 6c8f8a14-82d9-4940-bc62-063af3374684 to 73502f65-f45f-43f6-8626-9fdfabb4a053. {{(pid=84177) _handle_bootable_volume_glance_meta /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:450}}
Sep 24 18:47:58 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Creating volume glance metadata for volume 73502f65-f45f-43f6-8626-9fdfabb4a053 backed by image 6c8f8a14-82d9-4940-bc62-063af3374684 with: {'image_id': '6c8f8a14-82d9-4940-bc62-063af3374684', 'image_name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'checksum': 'c600970be6bbe68b6db2acc461c31601', 'container_format': 'bare', 'disk_format': 'raw', 'min_disk': 1, 'min_ram': 0, 'size': 1024}. {{(pid=84177) _capture_volume_image_metadata /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:682}}
Sep 24 18:47:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (da032676-718a-4f59-9111-bcd5e39ee626) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-73502f65-f45f-43f6-8626-9fdfabb4a053', 'volume_size': 1, 'image_id': '6c8f8a14-82d9-4940-bc62-063af3374684', 'image_location': (None, [{'url': 'file:///opt/stack/data/glance/images/6c8f8a14-82d9-4940-bc62-063af3374684', 'metadata': {}}]), 'image_meta': {'name': 'image-for-test-7a9fba78-2e4b-42b1-9898-bb4a60685320', 'disk_format': 'raw', 'container_format': 'bare', 'visibility': 'shared', 'size': 1024, 'virtual_size': 1024, 'status': 'active', 'checksum': 'c600970be6bbe68b6db2acc461c31601', 'protected': False, 'min_ram': 0, 'min_disk': 1, 'owner': 'e160f5b2e43b4c0ab41819f4d31bd89e', 'os_hidden': False, 'os_hash_algo': 'sha512', 'os_hash_value': 'aaeb410cfa9e6a0c7cd3d1fdee66326b1c59f6c4c42126d6ea2335f0bb7060bc83eece73a695bc41c852ce8cd22b328d44978947399b956d6a60b399093118d6', 'id': '6c8f8a14-82d9-4940-bc62-063af3374684', 'created_at': datetime.datetime(2025, 9, 24, 16, 47, 30, tzinfo=datetime.timezone.utc), 'updated_at': datetime.datetime(2025, 9, 24, 16, 47, 33, tzinfo=datetime.timezone.utc), 'tags': [], 'file': '/v2/images/6c8f8a14-82d9-4940-bc62-063af3374684/file', 'properties': {}}, 'image_service': <cinder.image.glance.GlanceImageService object at 0x7f3029b63f40>}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f0eed2-6211-43a2-bcf5-b3aefbb547f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:58 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Volume volume-73502f65-f45f-43f6-8626-9fdfabb4a053 (73502f65-f45f-43f6-8626-9fdfabb4a053): created successfully
Sep 24 18:47:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (d5f0eed2-6211-43a2-bcf5-b3aefbb547f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:58 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Flow 'volume_create_manager' (6a8952d7-ed7c-4617-91cc-909a7bf14511) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:58 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-bfee7125-8e2f-471c-9cdc-262094d40eb9 tempest-VolumeImageDependencyTests-258889033 None] Created volume successfully.
Sep 24 18:47:59 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Flow 'volume_create_manager' (a552a792-9824-4ac4-8df0-7580ab3984bd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad15dea-9ad1-4049-bbc3-6d05eb5ddce7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0ad15dea-9ad1-4049-bbc3-6d05eb5ddce7) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-952834498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d901d026-a591-4b73-a338-ea8c0bec7a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134aa317c73141faa9a15ffc8d18a06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:59Z,use_quota=True,user_id='e2692a3b759946088c00cdc4ddbba7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a35c639-60b8-4034-a60a-de052cfafe80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1a35c639-60b8-4034-a60a-de052cfafe80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc072a1-3c43-4422-b857-642a1b23da25) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (cbc072a1-3c43-4422-b857-642a1b23da25) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'd901d026-a591-4b73-a338-ea8c0bec7a5b', 'volume_name': 'volume-d901d026-a591-4b73-a338-ea8c0bec7a5b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48643521-1602-4ad5-b417-7bff82f58fac) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (48643521-1602-4ad5-b417-7bff82f58fac) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccb120f-3c42-4e77-a2bb-d595557e81d5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:47:59 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume d901d026-a591-4b73-a338-ea8c0bec7a5b: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-d901d026-a591-4b73-a338-ea8c0bec7a5b', 'volume_size': 1}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:47:59Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-952834498',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=d901d026-a591-4b73-a338-ea8c0bec7a5b,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134aa317c73141faa9a15ffc8d18a06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:47:59Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:47:59Z,use_quota=True,user_id='e2692a3b759946088c00cdc4ddbba7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Creating volume d901d026-a591-4b73-a338-ea8c0bec7a5b {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:47:59 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:47:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:00 devstack quobyte-client[84204]: System call of process 100332 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:00 devstack quobyte-client[84204]: System call of process 100332 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:00 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=152, name=volume-d901d026-a591-4b73-a338-ea8c0bec7a5b, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Acquiring lock "cinder-73502f65-f45f-43f6-8626-9fdfabb4a053-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b 1073741824" returned: 0 in 0.646s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b" returned: 0 in 0.228s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] <== create_volume: return (921ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.933s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Lock "cinder-73502f65-f45f-43f6-8626-9fdfabb4a053-delete_volume" acquired by "delete_volume" :: waited 0.508s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:00 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bccb120f-3c42-4e77-a2bb-d595557e81d5) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-d901d026-a591-4b73-a338-ea8c0bec7a5b', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:00 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180e7880-35c2-4652-8742-11d7078c06df) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:01 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Acquiring lock "cinder-quobyte-73502f65-f45f-43f6-8626-9fdfabb4a053" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:01 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume volume-d901d026-a591-4b73-a338-ea8c0bec7a5b (d901d026-a591-4b73-a338-ea8c0bec7a5b): created successfully
Sep 24 18:48:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (180e7880-35c2-4652-8742-11d7078c06df) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:01 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Flow 'volume_create_manager' (a552a792-9824-4ac4-8df0-7580ab3984bd) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Lock "cinder-quobyte-73502f65-f45f-43f6-8626-9fdfabb4a053" acquired by "delete_volume" :: waited 0.049s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:01 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-8c111f9a-d639-41c4-8ba3-dda56d6dd4ee tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created volume successfully.
Sep 24 18:48:01 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[782b578f-2f6e-4151-9cdd-b12bddd09790]: (4, 'raw') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:01 devstack quobyte-client[84204]: System call of process 100337 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f raw --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053" returned: 0 in 0.564s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:02 devstack quobyte-client[84204]: System call of process 100339 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:02 devstack quobyte-client[84204]: System call of process 100339 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053" returned: 1 in 1.024s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] '/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f luks --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053' failed. Not Retrying. {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:423}}
Sep 24 18:48:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:03 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.007s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Creating offline snapshot cd68da29-c90f-433c-bb44-2f5bfb4831bc of volume d901d026-a591-4b73-a338-ea8c0bec7a5b {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:48:03 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ee0ebbb0-3164-442a-98a8-34826c4b162e]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-73502f65-f45f-43f6-8626-9fdfabb4a053" returned: 0 in 0.596s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Lock "cinder-quobyte-73502f65-f45f-43f6-8626-9fdfabb4a053" released by "delete_volume" :: held 2.825s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:04 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:04 devstack quobyte-client[84204]: System call of process 100344 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Flow 'volume_create_manager' (d3a4fca8-1ac3-4165-b38d-d893c46fb1a4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc519bc-c4bc-43f2-b9ab-a764f5ab4743) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (9dc519bc-c4bc-43f2-b9ab-a764f5ab4743) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1382645699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86d4d60-448b-4c2d-a06e-41b5bbdb45f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8782948684914780ac4e52d6123a549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:04Z,use_quota=True,user_id='98101e3d7ac849919d77c493f533c118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce777b67-2e2a-4d0b-9608-a54967317c89) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (ce777b67-2e2a-4d0b-9608-a54967317c89) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d8da62-36b1-4254-b4e6-a3f21ef527a6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (58d8da62-36b1-4254-b4e6-a3f21ef527a6) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b86d4d60-448b-4c2d-a06e-41b5bbdb45f4', 'volume_name': 'volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479bad04-7180-4c30-bc04-82fc10cd6828) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (479bad04-7180-4c30-bc04-82fc10cd6828) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1f2fc6-ca35-4c7b-a736-a9d0accdc8e7) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:04 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Volume b86d4d60-448b-4c2d-a06e-41b5bbdb45f4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4', 'volume_size': 1}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b" returned: 0 in 0.823s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:04 devstack quobyte-client[84204]: System call of process 100347 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:04 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=153, name=volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc 1G" returned: 0 in 0.361s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): qemu-img rebase -u -b volume-d901d026-a591-4b73-a338-ea8c0bec7a5b -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:04 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Created reservations ['fe97da83-4198-43d4-b07f-b0db6b3f3050', '17f6e1aa-7bba-4721-9d3a-e83de9be0ce7', 'f23fa319-8dd1-4669-a59c-75f029f34867', '971e3119-ff1e-46ca-9fc0-c0ef88da81e4'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:04 devstack quobyte-client[84204]: System call of process 100350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:04 devstack quobyte-client[84204]: System call of process 100350 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "qemu-img rebase -u -b volume-d901d026-a591-4b73-a338-ea8c0bec7a5b -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc" returned: 0 in 0.370s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc" returned: 0 in 0.218s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc" returned: 0 in 0.437s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.208s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:05 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Deleted volume successfully.
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.info" returned: 0 in 0.324s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-51f4dd34-b465-4864-8611-2367f89572e0 tempest-VolumeImageDependencyTests-258889033 None] Lock "cinder-73502f65-f45f-43f6-8626-9fdfabb4a053-delete_volume" released by "delete_volume" :: held 5.465s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.info" returned: 0 in 0.302s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.276s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.266s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:03Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-SnapshotDependencyTests-volume-1382645699',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b86d4d60-448b-4c2d-a06e-41b5bbdb45f4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8782948684914780ac4e52d6123a549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:04Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:04Z,use_quota=True,user_id='98101e3d7ac849919d77c493f533c118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Creating volume b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:06 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:48:06 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:06 devstack quobyte-client[84204]: System call of process 100358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:06 devstack quobyte-client[84204]: System call of process 100358 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:06 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=155, name=volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:07 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-f7fa25ea-2274-4d41-8b53-87a49b2e8653 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Create snapshot completed successfully
Sep 24 18:48:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 1073741824" returned: 0 in 0.498s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" returned: 0 in 0.136s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:07 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] <== create_volume: return (689ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:07 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.716s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bd1f2fc6-ca35-4c7b-a736-a9d0accdc8e7) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbd9f7e-2d8b-42fb-9fdc-82a707d6c59e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:07 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Volume volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 (b86d4d60-448b-4c2d-a06e-41b5bbdb45f4): created successfully
Sep 24 18:48:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (3cbd9f7e-2d8b-42fb-9fdc-82a707d6c59e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:07 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Flow 'volume_create_manager' (d3a4fca8-1ac3-4165-b38d-d893c46fb1a4) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:07 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-40f24c8e-49c2-4f12-a867-e2fca2e9365a tempest-SnapshotDependencyTests-237237147 None] Created volume successfully.
Sep 24 18:48:08 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Flow 'volume_create_manager' (e2681279-06d3-4302-98b5-927a0d7277f1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc9b9a4-737b-4a7d-b07e-0c4e6f18e14e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (0fc9b9a4-737b-4a7d-b07e-0c4e6f18e14e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1981004438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514fddd5-ec4a-4012-b1b0-0cb351c78531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134aa317c73141faa9a15ffc8d18a06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:08Z,use_quota=True,user_id='e2692a3b759946088c00cdc4ddbba7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edbe0ce-fe17-483f-bbf4-4b5165f8d3ed) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (3edbe0ce-fe17-483f-bbf4-4b5165f8d3ed) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b25dbd-f0c5-407b-a3af-50fa41ad63ec) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e1b25dbd-f0c5-407b-a3af-50fa41ad63ec) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '514fddd5-ec4a-4012-b1b0-0cb351c78531', 'volume_name': 'volume-514fddd5-ec4a-4012-b1b0-0cb351c78531', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfa2b18-9d88-4103-bb73-a0b806475c3b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (9bfa2b18-9d88-4103-bb73-a0b806475c3b) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed26ff97-a449-4c08-bd2e-980ef845b94a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:08 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume 514fddd5-ec4a-4012-b1b0-0cb351c78531: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-514fddd5-ec4a-4012-b1b0-0cb351c78531', 'volume_size': 1}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-1981004438',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=514fddd5-ec4a-4012-b1b0-0cb351c78531,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134aa317c73141faa9a15ffc8d18a06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:08Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:08Z,use_quota=True,user_id='e2692a3b759946088c00cdc4ddbba7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Creating volume 514fddd5-ec4a-4012-b1b0-0cb351c78531 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:08 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:48:08 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-514fddd5-ec4a-4012-b1b0-0cb351c78531 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:08 devstack quobyte-client[84204]: System call of process 100368 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:08 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=156, name=volume-514fddd5-ec4a-4012-b1b0-0cb351c78531, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-514fddd5-ec4a-4012-b1b0-0cb351c78531 1073741824" returned: 0 in 0.847s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-514fddd5-ec4a-4012-b1b0-0cb351c78531 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:09 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-514fddd5-ec4a-4012-b1b0-0cb351c78531" returned: 0 in 0.407s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] <== create_volume: return (1352ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.358s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.093s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (ed26ff97-a449-4c08-bd2e-980ef845b94a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-514fddd5-ec4a-4012-b1b0-0cb351c78531', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32279d8e-1902-429d-a476-e56921ff20fd) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:10 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Flow 'volume_create_manager' (3c735b1d-75fd-4ca9-b209-11c55984fe53) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1592d7b5-7521-4dfa-801b-5a21631007b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:10 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume volume-514fddd5-ec4a-4012-b1b0-0cb351c78531 (514fddd5-ec4a-4012-b1b0-0cb351c78531): created successfully
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (32279d8e-1902-429d-a476-e56921ff20fd) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Flow 'volume_create_manager' (e2681279-06d3-4302-98b5-927a0d7277f1) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Creating offline snapshot 39caa452-aabf-482e-b590-d5919b9bcb62 of volume b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:48:10 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-fd14abbd-1580-47d0-a5f6-659cc6ab6559 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created volume successfully.
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[438c5bad-9655-40c3-999c-5633e226bab2]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1592d7b5-7521-4dfa-801b-5a21631007b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-730602550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40fcc398-043c-4e27-95ba-8a58ffb04b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134aa317c73141faa9a15ffc8d18a06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:09Z,use_quota=True,user_id='e2692a3b759946088c00cdc4ddbba7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0835d4-a519-41dd-bc64-5486ef6f5b6d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (de0835d4-a519-41dd-bc64-5486ef6f5b6d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f210a0-d637-4e6b-90c3-05343e011747) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (e7f210a0-d637-4e6b-90c3-05343e011747) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '40fcc398-043c-4e27-95ba-8a58ffb04b20', 'volume_name': 'volume-40fcc398-043c-4e27-95ba-8a58ffb04b20', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3aaee84-1cc7-4a89-8ab2-87c9f9634d9d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b3aaee84-1cc7-4a89-8ab2-87c9f9634d9d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c9e7a0-fea8-4439-adf6-e9cee9338d86) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:10 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume 40fcc398-043c-4e27-95ba-8a58ffb04b20: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-40fcc398-043c-4e27-95ba-8a58ffb04b20', 'volume_size': 1}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:10 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:10 devstack quobyte-client[84204]: System call of process 100373 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Flow 'volume_create_manager' (619c284e-4bec-42dd-ace0-cde7161cecf3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0e7f8c-98dc-452e-8d2a-83f0574d8898) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8a0e7f8c-98dc-452e-8d2a-83f0574d8898) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-955920886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a38c1f5-cb64-4a1a-82f7-541bbce63c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134aa317c73141faa9a15ffc8d18a06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:10Z,use_quota=True,user_id='e2692a3b759946088c00cdc4ddbba7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b47ff17-4877-4ccc-a6e3-7aed8e941aa3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1b47ff17-4877-4ccc-a6e3-7aed8e941aa3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16c7b4f-ed46-45aa-840a-dd38393dcf24) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c16c7b4f-ed46-45aa-840a-dd38393dcf24) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '6a38c1f5-cb64-4a1a-82f7-541bbce63c73', 'volume_name': 'volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c71ab8-135e-4fbc-80f3-0f85c41f53ea) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (02c71ab8-135e-4fbc-80f3-0f85c41f53ea) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190ed404-3228-4192-9fd7-985ae03d8690) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:10 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume 6a38c1f5-cb64-4a1a-82f7-541bbce63c73: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73', 'volume_size': 1}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" returned: 0 in 0.730s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:10 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:11 devstack quobyte-client[84204]: System call of process 100376 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:11 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:11 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=157, name=volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Flow 'volume_create_manager' (223764fb-1cab-45f4-aa08-35a3fde29202) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00711167-7700-413f-b476-200f7843d1e4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (00711167-7700-413f-b476-200f7843d1e4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-171252467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c4255a-6443-4d11-a46b-a2c9cd4a2e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134aa317c73141faa9a15ffc8d18a06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:10Z,use_quota=True,user_id='e2692a3b759946088c00cdc4ddbba7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72aa1890-b68c-479c-81b7-00fb0ba883c1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (72aa1890-b68c-479c-81b7-00fb0ba883c1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272d255d-d9d6-4748-8aa1-30ac16021f03) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (272d255d-d9d6-4748-8aa1-30ac16021f03) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '77c4255a-6443-4d11-a46b-a2c9cd4a2e70', 'volume_name': 'volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963786af-0a7d-4ee9-a9ea-5556f338048f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (963786af-0a7d-4ee9-a9ea-5556f338048f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5434ecb-7123-4cb3-a9e8-a46696ec1bb4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:11 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume 77c4255a-6443-4d11-a46b-a2c9cd4a2e70: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70', 'volume_size': 1}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62 1G" returned: 0 in 0.571s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): qemu-img rebase -u -b volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:11 devstack quobyte-client[84204]: System call of process 100380 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:11 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Flow 'volume_create_manager' (72327967-52d8-42cc-ba86-8a1bab2b6367) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a433e005-3187-47a5-9b3b-4f3d72dac18d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] CMD "qemu-img rebase -u -b volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62" returned: 0 in 0.429s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:48:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (a433e005-3187-47a5-9b3b-4f3d72dac18d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-16111603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d33b96-f713-4a3c-9843-6a460fc4324c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134aa317c73141faa9a15ffc8d18a06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:11Z,use_quota=True,user_id='e2692a3b759946088c00cdc4ddbba7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c010955-1576-40ca-8228-5190e74b6298) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (1c010955-1576-40ca-8228-5190e74b6298) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c11ca2-7244-4557-952d-298eaf3a7c3e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (08c11ca2-7244-4557-952d-298eaf3a7c3e) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b2d33b96-f713-4a3c-9843-6a460fc4324c', 'volume_name': 'volume-b2d33b96-f713-4a3c-9843-6a460fc4324c', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e723e67-1b88-42d0-bafa-610f6d293d80) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (4e723e67-1b88-42d0-bafa-610f6d293d80) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b969207a-be98-4dde-bfed-372bc00f9d8c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:12 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume b2d33b96-f713-4a3c-9843-6a460fc4324c: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b2d33b96-f713-4a3c-9843-6a460fc4324c', 'volume_size': 1}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62" returned: 0 in 0.359s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62" returned: 0 in 0.152s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_service.periodic_task [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running periodic task VolumeManager.publish_service_capabilities {{(pid=84177) run_periodic_tasks /opt/stack/data/venv/lib/python3.10/site-packages/oslo_service/periodic_task.py:210}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.info" returned: 0 in 0.276s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.211s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-6a26a897-7e9a-49cc-b7e0-7f8da7176d84 None None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.info" returned: 0 in 0.225s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 3.158s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 2.624s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:08Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-730602550',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=40fcc398-043c-4e27-95ba-8a58ffb04b20,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134aa317c73141faa9a15ffc8d18a06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:09Z,use_quota=True,user_id='e2692a3b759946088c00cdc4ddbba7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Creating volume 40fcc398-043c-4e27-95ba-8a58ffb04b20 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.027s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:13 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-40fcc398-043c-4e27-95ba-8a58ffb04b20 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:13 devstack quobyte-client[84204]: System call of process 100420 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:13 devstack quobyte-client[84204]: System call of process 100420 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:13 devstack quobyte-client[84204]: System call of process 100420 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:13 devstack quobyte-client[84204]: System call of process 100420 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:13 devstack quobyte-client[84204]: System call of process 100420 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:13 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=159, name=volume-40fcc398-043c-4e27-95ba-8a58ffb04b20, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:13 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d1148a70-d8df-478c-afa9-f35c02cd9595 tempest-SnapshotDependencyTests-237237147 None] Create snapshot completed successfully
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-40fcc398-043c-4e27-95ba-8a58ffb04b20 1073741824" returned: 0 in 0.413s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-40fcc398-043c-4e27-95ba-8a58ffb04b20 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-40fcc398-043c-4e27-95ba-8a58ffb04b20" returned: 0 in 0.129s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] <== create_volume: return (600ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.620s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.005s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:09Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-955920886',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=6a38c1f5-cb64-4a1a-82f7-541bbce63c73,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134aa317c73141faa9a15ffc8d18a06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:10Z,use_quota=True,user_id='e2692a3b759946088c00cdc4ddbba7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Creating volume 6a38c1f5-cb64-4a1a-82f7-541bbce63c73 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.019s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:13 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:48:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:14 devstack quobyte-client[84204]: System call of process 100424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:14 devstack quobyte-client[84204]: System call of process 100424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:14 devstack quobyte-client[84204]: System call of process 100424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:14 devstack quobyte-client[84204]: System call of process 100424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:14 devstack quobyte-client[84204]: System call of process 100424 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:14 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=160, name=volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (10c9e7a0-fea8-4439-adf6-e9cee9338d86) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-40fcc398-043c-4e27-95ba-8a58ffb04b20', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134a6e96-142c-42b8-9111-86bb2d9188b8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:14 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume volume-40fcc398-043c-4e27-95ba-8a58ffb04b20 (40fcc398-043c-4e27-95ba-8a58ffb04b20): created successfully
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (134a6e96-142c-42b8-9111-86bb2d9188b8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Flow 'volume_create_manager' (3c735b1d-75fd-4ca9-b209-11c55984fe53) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73 1073741824" returned: 0 in 0.461s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:14 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-adc53d9d-0f07-4cd6-ac12-85e778a40b80 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created volume successfully.
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73" returned: 0 in 0.240s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] <== create_volume: return (742ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.763s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.214s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-171252467',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=77c4255a-6443-4d11-a46b-a2c9cd4a2e70,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134aa317c73141faa9a15ffc8d18a06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:10Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:10Z,use_quota=True,user_id='e2692a3b759946088c00cdc4ddbba7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Creating volume 77c4255a-6443-4d11-a46b-a2c9cd4a2e70 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:14 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:14 devstack quobyte-client[84204]: System call of process 100428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:14 devstack quobyte-client[84204]: System call of process 100428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:14 devstack quobyte-client[84204]: System call of process 100428 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:14 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=161, name=volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:14 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (190ed404-3228-4192-9fd7-985ae03d8690) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2324527d-9e4e-4eb5-abf2-e2b380706d9e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:15 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73 (6a38c1f5-cb64-4a1a-82f7-541bbce63c73): created successfully
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2324527d-9e4e-4eb5-abf2-e2b380706d9e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Flow 'volume_create_manager' (619c284e-4bec-42dd-ace0-cde7161cecf3) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70 1073741824" returned: 0 in 0.559s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:15 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-b7d32ff1-9e8f-4601-b973-6e3fc52b1470 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created volume successfully.
Sep 24 18:48:15 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70" returned: 0 in 0.384s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] <== create_volume: return (986ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 3.488s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:10Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSnapshotTest-Volume-16111603',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b2d33b96-f713-4a3c-9843-6a460fc4324c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='134aa317c73141faa9a15ffc8d18a06f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:11Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:11Z,use_quota=True,user_id='e2692a3b759946088c00cdc4ddbba7ab',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Creating volume b2d33b96-f713-4a3c-9843-6a460fc4324c {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:15 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:48:15 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b2d33b96-f713-4a3c-9843-6a460fc4324c 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:15 devstack quobyte-client[84204]: System call of process 100432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:15 devstack quobyte-client[84204]: System call of process 100432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:15 devstack quobyte-client[84204]: System call of process 100432 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:15 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=162, name=volume-b2d33b96-f713-4a3c-9843-6a460fc4324c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Flow 'volume_create_manager' (b17c66c7-7981-4875-b780-4739ffa9b281) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2a911b-b5fe-458d-9308-f07d5a21d97e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (ed2a911b-b5fe-458d-9308-f07d5a21d97e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:15Z,deleted=False,deleted_at=None,display_description=None,display_name=None,ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=bcb77bc4-96eb-4e18-b9b8-48807a03930c,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='8782948684914780ac4e52d6123a549b',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:15Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=39caa452-aabf-482e-b590-d5919b9bcb62,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:15Z,use_quota=True,user_id='98101e3d7ac849919d77c493f533c118',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40eafc4-981a-4848-9f8c-5ebf2026cbbb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (d40eafc4-981a-4848-9f8c-5ebf2026cbbb) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fc599a-aced-4df5-b055-5c6f1e47c218) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (21fc599a-aced-4df5-b055-5c6f1e47c218) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'snap', 'volume_id': 'bcb77bc4-96eb-4e18-b9b8-48807a03930c', 'volume_name': 'volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c', 'volume_size': 1, 'snapshot_id': '39caa452-aabf-482e-b590-d5919b9bcb62'}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191f1a87-3cf4-4c9a-899c-ccf9b2cfc88d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (191f1a87-3cf4-4c9a-899c-ccf9b2cfc88d) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9be86cb-683a-4b89-bd07-34676152dcc8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:16 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Volume bcb77bc4-96eb-4e18-b9b8-48807a03930c: being created as snap with specification: {'status': 'creating', 'volume_name': 'volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c', 'volume_size': 1, 'snapshot_id': '39caa452-aabf-482e-b590-d5919b9bcb62'}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (d5434ecb-7123-4cb3-a9e8-a46696ec1bb4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a73693-fa87-40ca-ab75-04d8037d5278) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b2d33b96-f713-4a3c-9843-6a460fc4324c 1073741824" returned: 0 in 0.586s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b2d33b96-f713-4a3c-9843-6a460fc4324c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:16 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70 (77c4255a-6443-4d11-a46b-a2c9cd4a2e70): created successfully
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a0a73693-fa87-40ca-ab75-04d8037d5278) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Flow 'volume_create_manager' (223764fb-1cab-45f4-aa08-35a3fde29202) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b2d33b96-f713-4a3c-9843-6a460fc4324c" returned: 0 in 0.342s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] <== create_volume: return (954ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.964s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: waited 0.365s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "cinder-quobyte-39caa452-aabf-482e-b590-d5919b9bcb62-bcb77bc4-96eb-4e18-b9b8-48807a03930c" by "_create_volume_from_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:16 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-544a42a1-b2a1-473c-9780-7ad618f61427 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created volume successfully.
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b969207a-be98-4dde-bfed-372bc00f9d8c) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b2d33b96-f713-4a3c-9843-6a460fc4324c', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df99943f-ce62-4ce4-84ff-bc787628c0d2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-quobyte-39caa452-aabf-482e-b590-d5919b9bcb62-bcb77bc4-96eb-4e18-b9b8-48807a03930c" acquired by "_create_volume_from_snapshot" :: waited 0.103s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Creating volume bcb77bc4-96eb-4e18-b9b8-48807a03930c from snapshot 39caa452-aabf-482e-b590-d5919b9bcb62 {{(pid=84177) _create_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:358}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "cinder-quobyte-bcb77bc4-96eb-4e18-b9b8-48807a03930c" by "_copy_volume_from_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:16 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume volume-b2d33b96-f713-4a3c-9843-6a460fc4324c (b2d33b96-f713-4a3c-9843-6a460fc4324c): created successfully
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (df99943f-ce62-4ce4-84ff-bc787628c0d2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Flow 'volume_create_manager' (72327967-52d8-42cc-ba86-8a1bab2b6367) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-quobyte-bcb77bc4-96eb-4e18-b9b8-48807a03930c" acquired by "_copy_volume_from_snapshot" :: waited 0.025s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] snapshot: 39caa452-aabf-482e-b590-d5919b9bcb62, volume: bcb77bc4-96eb-4e18-b9b8-48807a03930c,  {{(pid=84177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:395}}
Sep 24 18:48:16 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-5f839811-819c-41ee-b97d-a1631b1a5d72 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created volume successfully.
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a5a4b305-7a5e-41e6-a0bf-b2a4ac3d9f6d]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:17 devstack quobyte-client[84204]: System call of process 100436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:17 devstack quobyte-client[84204]: System call of process 100436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:17 devstack quobyte-client[84204]: System call of process 100436 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62" returned: 0 in 0.406s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:17 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:48:17 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] will copy from snapshot at /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 {{(pid=84177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:414}}
Sep 24 18:48:17 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Creating direct copy from snapshot {{(pid=84177) _copy_volume_from_snapshot /opt/stack/cinder/cinder/volume/drivers/quobyte.py:422}}
Sep 24 18:48:17 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3575c9ca-1d9c-403b-89d5-02a26a1aa6fa]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:17 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-b2d33b96-f713-4a3c-9843-6a460fc4324c-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:17 devstack quobyte-client[84204]: System call of process 100439 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:17 devstack quobyte-client[84204]: System call of process 100439 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" returned: 0 in 0.479s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:17 devstack cinder-volume[84177]: DEBUG cinder.utils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c not found in is_blk_device check {{(pid=84177) is_blk_device /opt/stack/cinder/cinder/utils.py:591}}
Sep 24 18:48:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:18 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=163, name=volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-b2d33b96-f713-4a3c-9843-6a460fc4324c-delete_volume" acquired by "delete_volume" :: waited 0.389s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:18 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-quobyte-b2d33b96-f713-4a3c-9843-6a460fc4324c" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-b2d33b96-f713-4a3c-9843-6a460fc4324c" acquired by "delete_volume" :: waited 0.045s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:18 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[18d0784f-c07f-418d-a4fc-a29d6812925b]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b2d33b96-f713-4a3c-9843-6a460fc4324c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:19 devstack quobyte-client[84204]: System call of process 100452 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b2d33b96-f713-4a3c-9843-6a460fc4324c" returned: 0 in 1.017s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b2d33b96-f713-4a3c-9843-6a460fc4324c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b2d33b96-f713-4a3c-9843-6a460fc4324c" returned: 0 in 0.249s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-b2d33b96-f713-4a3c-9843-6a460fc4324c" released by "delete_volume" :: held 1.683s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:20 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=57,cinder:UPDATE=72,cinder:DELETE=16,cinder:INSERT=15 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:48:21 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=86,cinder:SELECT=55,cinder:DELETE=5,cinder:INSERT=18 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:48:21 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created reservations ['74255bab-9053-43fb-9ead-e77692a01c7a', '5c56649f-3bbd-4cfd-a345-8293fb58ca49', '1e7b5472-69c3-47d2-97f5-0f25bdc114d1', 'db94e419-2348-4748-9040-c2ea14e556e5'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:22 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.252s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:22 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:22 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Deleted volume successfully.
Sep 24 18:48:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-77c4255a-6443-4d11-a46b-a2c9cd4a2e70-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bd6242a6-a788-450b-b5a8-650c9396cbe0 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-b2d33b96-f713-4a3c-9843-6a460fc4324c-delete_volume" released by "delete_volume" :: held 5.471s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:23 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-77c4255a-6443-4d11-a46b-a2c9cd4a2e70-delete_volume" acquired by "delete_volume" :: waited 0.458s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] CMD "qemu-img convert -O qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c" returned: 0 in 5.928s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:23 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[423c5a11-2b4e-4a32-9264-28b4fc2b72c4]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:23 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:24 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:24 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-quobyte-77c4255a-6443-4d11-a46b-a2c9cd4a2e70" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:24 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-77c4255a-6443-4d11-a46b-a2c9cd4a2e70" acquired by "delete_volume" :: waited 0.057s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:24 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[9ba34ae5-ee06-457c-ac77-a54f8beca972]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" returned: 0 in 0.760s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:24 devstack cinder-volume[84177]: DEBUG cinder.image.image_utils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Image conversion details: src /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4, size 1024.00 MB, duration 5.93 sec, destination /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c {{(pid=84177) _convert_image /opt/stack/cinder/cinder/image/image_utils.py:501}}
Sep 24 18:48:24 devstack cinder-volume[84177]: INFO cinder.image.image_utils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Converted 1024.00 MB image at 172.60 MB/s
Sep 24 18:48:24 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:48:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c" returned: 0 in 0.090s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:24 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-quobyte-bcb77bc4-96eb-4e18-b9b8-48807a03930c" released by "_copy_volume_from_snapshot" :: held 8.047s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:24 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-quobyte-39caa452-aabf-482e-b590-d5919b9bcb62-bcb77bc4-96eb-4e18-b9b8-48807a03930c" released by "_create_volume_from_snapshot" :: held 8.105s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:24 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume_from_snapshot" :: held 8.225s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70" returned: 0 in 0.733s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f9be86cb-683a-4b89-bd07-34676152dcc8) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c', 'volume_size': 1, 'snapshot_id': '39caa452-aabf-482e-b590-d5919b9bcb62'}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51b3a3d-07f1-45a2-aff8-048409584b38) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-77c4255a-6443-4d11-a46b-a2c9cd4a2e70" returned: 0 in 0.301s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:25 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Volume volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c (bcb77bc4-96eb-4e18-b9b8-48807a03930c): created successfully
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (a51b3a3d-07f1-45a2-aff8-048409584b38) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Flow 'volume_create_manager' (b17c66c7-7981-4875-b780-4739ffa9b281) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-77c4255a-6443-4d11-a46b-a2c9cd4a2e70" released by "delete_volume" :: held 1.206s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:25 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-c9f948b1-d8a8-4b86-91d9-336f490fb30f tempest-SnapshotDependencyTests-237237147 None] Created volume successfully.
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created reservations ['90c78fd4-05b8-4165-a2e0-7d61bc511d0f', 'ca4fda7b-da7b-47cb-ae4a-a3d0080c145b', '0e9b617d-0336-46a2-9eeb-d72ef86822c9', '0c9c1678-7d6d-4d52-84f3-d5ffa14f5e55'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.095s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:25 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:26 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Deleted volume successfully.
Sep 24 18:48:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-52dd0628-5838-4ef0-b8b9-4eafb5c5a217 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-77c4255a-6443-4d11-a46b-a2c9cd4a2e70-delete_volume" released by "delete_volume" :: held 2.380s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-6a38c1f5-cb64-4a1a-82f7-541bbce63c73-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-6a38c1f5-cb64-4a1a-82f7-541bbce63c73-delete_volume" acquired by "delete_volume" :: waited 0.035s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "cinder-39caa452-aabf-482e-b590-d5919b9bcb62-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:26 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-quobyte-6a38c1f5-cb64-4a1a-82f7-541bbce63c73" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-39caa452-aabf-482e-b590-d5919b9bcb62-delete_snapshot" acquired by "delete_snapshot" :: waited 0.051s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:26 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "cinder-quobyte-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-6a38c1f5-cb64-4a1a-82f7-541bbce63c73" acquired by "delete_volume" :: waited 0.024s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-quobyte-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" acquired by "delete_snapshot" :: waited 0.034s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:26 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "cinder-quobyte-39caa452-aabf-482e-b590-d5919b9bcb62" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:26 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[2cacf0ef-82d8-48c7-b669-a0acb2c224fa]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:26 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-quobyte-39caa452-aabf-482e-b590-d5919b9bcb62" acquired by "_delete_snapshot" :: waited 0.185s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Deleting offline snapshot 39caa452-aabf-482e-b590-d5919b9bcb62 of volume b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] snapshot_file for this snap is: volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ceda92d9-a472-4b15-a5b4-2f2ba61403b5]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73" returned: 0 in 0.529s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-6a38c1f5-cb64-4a1a-82f7-541bbce63c73" returned: 0 in 0.093s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:27 devstack quobyte-client[84204]: System call of process 100468 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-6a38c1f5-cb64-4a1a-82f7-541bbce63c73" released by "delete_volume" :: held 0.868s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62" returned: 0 in 0.733s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ddcb34a0-e835-4efb-9330-1d3b0ff16646]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:27 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created reservations ['2700985b-97ce-4eb7-9a9f-69a2a726f80d', '6971761c-340f-46ad-a62a-37ef97597fa7', 'f3249025-5981-41ef-809b-c3d73fac5baa', 'e35eca0e-f8bf-4a45-9066-ca57e4f27261'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:28 devstack quobyte-client[84204]: System call of process 100474 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.028s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" returned: 0 in 0.610s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.208s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:28 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Deleted volume successfully.
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62" returned: 0 in 0.373s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:28 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:29 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-d2bb0374-32cf-4ca3-8e2e-6840027cbca6 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-6a38c1f5-cb64-4a1a-82f7-541bbce63c73-delete_volume" released by "delete_volume" :: held 2.396s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:29 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-40fcc398-043c-4e27-95ba-8a58ffb04b20-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4.39caa452-aabf-482e-b590-d5919b9bcb62" returned: 0 in 0.283s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:29 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-40fcc398-043c-4e27-95ba-8a58ffb04b20-delete_volume" acquired by "delete_volume" :: waited 0.092s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:29 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-quobyte-39caa452-aabf-482e-b590-d5919b9bcb62" released by "_delete_snapshot" :: held 2.301s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:29 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-quobyte-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" released by "delete_snapshot" :: held 2.516s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:29 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:29 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-quobyte-40fcc398-043c-4e27-95ba-8a58ffb04b20" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:29 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-40fcc398-043c-4e27-95ba-8a58ffb04b20" acquired by "delete_volume" :: waited 0.020s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:29 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[c11fd3d1-3cec-4e5c-9657-915001dfe5ab]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:29 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-40fcc398-043c-4e27-95ba-8a58ffb04b20 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-40fcc398-043c-4e27-95ba-8a58ffb04b20" returned: 0 in 0.475s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-40fcc398-043c-4e27-95ba-8a58ffb04b20 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Created reservations ['37a45490-13b3-4222-ac61-9170d9a8c54d', '0f572f6a-c31b-4822-92e5-2fc397fa1188', '4d19cd99-5cc1-4b4e-b93e-109eef5d9c0e', '77b5f6f9-81be-4176-b701-1ddf0cac835e'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-40fcc398-043c-4e27-95ba-8a58ffb04b20" returned: 0 in 0.255s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-40fcc398-043c-4e27-95ba-8a58ffb04b20" released by "delete_volume" :: held 0.852s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:30 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Delete snapshot completed successfully.
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-54600c12-8702-405e-9727-86e37c1ff8d0 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-39caa452-aabf-482e-b590-d5919b9bcb62-delete_snapshot" released by "delete_snapshot" :: held 3.725s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created reservations ['901a86bc-9958-4e1a-8a52-d3419844d5cc', '44fcf4aa-6f82-485c-ae32-faacb203252f', 'ea70404d-c0eb-4ac5-af37-4e92ecfb944d', 'ca5c0b11-5557-497c-8b39-e316873e4fa5'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.083s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:30 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:30 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Deleted volume successfully.
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-44fdb371-342b-4b7b-b617-dd00b711f541 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-40fcc398-043c-4e27-95ba-8a58ffb04b20-delete_volume" released by "delete_volume" :: held 1.766s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "cinder-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4-delete_volume" acquired by "delete_volume" :: waited 0.027s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:31 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "cinder-quobyte-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-quobyte-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" acquired by "delete_volume" :: waited 0.011s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-514fddd5-ec4a-4012-b1b0-0cb351c78531-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[e5e43ed8-c51c-4e8a-8e02-a7c1d89415df]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-514fddd5-ec4a-4012-b1b0-0cb351c78531-delete_volume" acquired by "delete_volume" :: waited 0.231s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:31 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-quobyte-514fddd5-ec4a-4012-b1b0-0cb351c78531" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:31 devstack quobyte-client[84204]: System call of process 100488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:31 devstack quobyte-client[84204]: System call of process 100488 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-514fddd5-ec4a-4012-b1b0-0cb351c78531" acquired by "delete_volume" :: waited 0.021s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" returned: 0 in 0.557s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:31 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[7f891984-5b9e-4f46-8c21-321e3e01c4ac]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-514fddd5-ec4a-4012-b1b0-0cb351c78531 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" returned: 0 in 0.195s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-quobyte-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4" released by "delete_volume" :: held 0.933s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Created reservations ['6fa7aaf2-20e0-4f32-82a1-c37d827fad63', '5e92d2c6-caf3-4dfd-90e7-b5508d1631b2', 'b10d0f59-492f-491f-b912-8b1f6f32aee1', '2be25c73-4c1f-4e87-8655-a586049fe8bf'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-514fddd5-ec4a-4012-b1b0-0cb351c78531" returned: 0 in 0.615s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-514fddd5-ec4a-4012-b1b0-0cb351c78531 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.023s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.023s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:32 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-514fddd5-ec4a-4012-b1b0-0cb351c78531" returned: 0 in 0.234s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.187s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-514fddd5-ec4a-4012-b1b0-0cb351c78531" released by "delete_volume" :: held 1.189s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:33 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Deleted volume successfully.
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-0f03abad-0adb-4308-a4a0-73535c9cd3e3 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-b86d4d60-448b-4c2d-a06e-41b5bbdb45f4-delete_volume" released by "delete_volume" :: held 2.133s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created reservations ['754d3132-3786-4ae4-9617-bf1b6142cb77', '1cbd1c79-75f1-459c-872b-55265af4eca1', 'b400bc06-e8c9-47ef-b4a6-ce19a750bc94', 'bf84eb5e-46b6-4ee7-a1b3-ae489c85f1d3'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "cinder-bcb77bc4-96eb-4e18-b9b8-48807a03930c-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-cd68da29-c90f-433c-bb44-2f5bfb4831bc-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.339s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-bcb77bc4-96eb-4e18-b9b8-48807a03930c-delete_volume" acquired by "delete_volume" :: waited 0.165s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-cd68da29-c90f-433c-bb44-2f5bfb4831bc-delete_snapshot" acquired by "delete_snapshot" :: waited 0.207s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:33 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:33 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-quobyte-d901d026-a591-4b73-a338-ea8c0bec7a5b" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:33 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Deleted volume successfully.
Sep 24 18:48:34 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "cinder-quobyte-bcb77bc4-96eb-4e18-b9b8-48807a03930c" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-d901d026-a591-4b73-a338-ea8c0bec7a5b" acquired by "delete_snapshot" :: waited 0.085s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-quobyte-cd68da29-c90f-433c-bb44-2f5bfb4831bc" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-quobyte-bcb77bc4-96eb-4e18-b9b8-48807a03930c" acquired by "delete_volume" :: waited 0.028s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ed945b7d-ebb2-4023-8185-4c9dfda10b1c tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-514fddd5-ec4a-4012-b1b0-0cb351c78531-delete_volume" released by "delete_volume" :: held 2.481s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-cd68da29-c90f-433c-bb44-2f5bfb4831bc" acquired by "_delete_snapshot" :: waited 0.041s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Deleting offline snapshot cd68da29-c90f-433c-bb44-2f5bfb4831bc of volume d901d026-a591-4b73-a338-ea8c0bec7a5b {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] snapshot_file for this snap is: volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[8c07e626-0f2b-4e4f-a772-d897aad14eb0]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[6a2ad2ae-48f0-4938-b110-77f7a5ac1ca4]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c" returned: 0 in 0.513s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:34 devstack quobyte-client[84204]: System call of process 100499 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:34 devstack quobyte-client[84204]: System call of process 100499 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:34 devstack quobyte-client[84204]: System call of process 100499 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc" returned: 0 in 0.499s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-d901d026-a591-4b73-a338-ea8c0bec7a5b(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[db98dde0-7e41-455a-8b5a-d59d0fe35c8e]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-bcb77bc4-96eb-4e18-b9b8-48807a03930c" returned: 0 in 0.192s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:34 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:35 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-quobyte-bcb77bc4-96eb-4e18-b9b8-48807a03930c" released by "delete_volume" :: held 0.985s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:35 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Created reservations ['4b8cf81c-6ff0-4da1-8b2f-9c98aa3e9344', 'e88f4c75-53ea-4818-850d-9aa23f71205f', '32b025d5-e540-4e70-ad3d-fe8d39a94a34', '3ba23116-2d18-46e9-9bc6-a0e7017bb40a'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b" returned: 0 in 0.540s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:35 devstack quobyte-client[84204]: System call of process 100510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:35 devstack quobyte-client[84204]: System call of process 100510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:35 devstack quobyte-client[84204]: System call of process 100510 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.017s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:35 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.031s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc" returned: 0 in 0.491s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:35 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.202s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:36 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:36 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Deleted volume successfully.
Sep 24 18:48:36 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b.cd68da29-c90f-433c-bb44-2f5bfb4831bc" returned: 0 in 0.332s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:36 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-cd68da29-c90f-433c-bb44-2f5bfb4831bc" released by "_delete_snapshot" :: held 2.312s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:36 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bde24620-a540-4cb8-aef1-a94ae23a0870 tempest-SnapshotDependencyTests-237237147 None] Lock "cinder-bcb77bc4-96eb-4e18-b9b8-48807a03930c-delete_volume" released by "delete_volume" :: held 2.580s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:36 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-d901d026-a591-4b73-a338-ea8c0bec7a5b" released by "delete_snapshot" :: held 2.382s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:36 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created reservations ['e7beabbb-2a03-42ab-9ac2-616da9821940', '5180a5b4-546a-4c04-b73a-7bc65e59cd5c', 'c7b28c30-95e4-4935-93fd-173f4585d4df', '144b539c-3ef4-4f05-b5eb-de69c4bba06d'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:36 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Delete snapshot completed successfully.
Sep 24 18:48:36 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-89f6702b-5fb8-4b04-8969-d56624063936 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-cd68da29-c90f-433c-bb44-2f5bfb4831bc-delete_snapshot" released by "delete_snapshot" :: held 2.727s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:36 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-d901d026-a591-4b73-a338-ea8c0bec7a5b-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:36 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-d901d026-a591-4b73-a338-ea8c0bec7a5b-delete_volume" acquired by "delete_volume" :: waited 0.023s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:37 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:37 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "cinder-quobyte-d901d026-a591-4b73-a338-ea8c0bec7a5b" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:37 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-d901d026-a591-4b73-a338-ea8c0bec7a5b" acquired by "delete_volume" :: waited 0.014s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:37 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[33beb207-dea6-406e-838d-cd66a41dfd3c]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b" returned: 0 in 0.441s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:37 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-d901d026-a591-4b73-a338-ea8c0bec7a5b" returned: 0 in 0.128s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:37 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-quobyte-d901d026-a591-4b73-a338-ea8c0bec7a5b" released by "delete_volume" :: held 0.774s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:38 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Created reservations ['51679145-f7d3-474e-80a5-d0feecdd2b68', '8e24a3a5-c3a0-47bf-bfaf-82f6c3b6e13e', 'f83df6a9-e788-4e76-8bef-c1e89d89c4a8', '405463e0-b7b4-4236-b517-6cfe62309d99'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:38 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.020s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:38 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.118s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:38 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:38 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Deleted volume successfully.
Sep 24 18:48:38 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-f35239ee-625c-4c14-ba1e-a46347c58b23 tempest-CreateVolumesFromSnapshotTest-1815227979 None] Lock "cinder-d901d026-a591-4b73-a338-ea8c0bec7a5b-delete_volume" released by "delete_volume" :: held 1.887s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:43 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Flow 'volume_create_manager' (11464bba-751e-4e3f-bf06-cc0fbe1851bf) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a60cd3c-a94d-4f10-982d-fa5528769fb3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (1a60cd3c-a94d-4f10-982d-fa5528769fb3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-744352135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5f8daf-1881-450e-b9d0-45586fb340e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b172a306111b477696da1fb1cf56da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:43Z,use_quota=True,user_id='cf2a7ac9ca3b402b804f1f0a28cf1d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcbf89f-e1a5-4e47-82fa-d4d0505000e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2dcbf89f-e1a5-4e47-82fa-d4d0505000e8) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3495372e-e99a-4c50-8cd1-f8c73f4864c4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3495372e-e99a-4c50-8cd1-f8c73f4864c4) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '5c5f8daf-1881-450e-b9d0-45586fb340e4', 'volume_name': 'volume-5c5f8daf-1881-450e-b9d0-45586fb340e4', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdc99b5-96f2-4ffa-934e-0e964bfbf76e) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (8bdc99b5-96f2-4ffa-934e-0e964bfbf76e) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc259270-7288-4e4c-8563-74afd6abdc33) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:43 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume 5c5f8daf-1881-450e-b9d0-45586fb340e4: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-5c5f8daf-1881-450e-b9d0-45586fb340e4', 'volume_size': 1}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:43Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-744352135',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=5c5f8daf-1881-450e-b9d0-45586fb340e4,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b172a306111b477696da1fb1cf56da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:43Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:43Z,use_quota=True,user_id='cf2a7ac9ca3b402b804f1f0a28cf1d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Creating volume 5c5f8daf-1881-450e-b9d0-45586fb340e4 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:43 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:48:43 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5c5f8daf-1881-450e-b9d0-45586fb340e4 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:43 devstack quobyte-client[84204]: System call of process 100525 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:43 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=164, name=volume-5c5f8daf-1881-450e-b9d0-45586fb340e4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5c5f8daf-1881-450e-b9d0-45586fb340e4 1073741824" returned: 0 in 0.376s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5c5f8daf-1881-450e-b9d0-45586fb340e4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5c5f8daf-1881-450e-b9d0-45586fb340e4" returned: 0 in 0.161s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:44 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] <== create_volume: return (611ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:44 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.627s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (bc259270-7288-4e4c-8563-74afd6abdc33) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-5c5f8daf-1881-450e-b9d0-45586fb340e4', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7bc5273-2941-47d8-8347-2d15e78f6976) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:44 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume volume-5c5f8daf-1881-450e-b9d0-45586fb340e4 (5c5f8daf-1881-450e-b9d0-45586fb340e4): created successfully
Sep 24 18:48:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (b7bc5273-2941-47d8-8347-2d15e78f6976) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:44 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Flow 'volume_create_manager' (11464bba-751e-4e3f-bf06-cc0fbe1851bf) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:44 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-1b47fc9d-6b11-450d-b5c8-cef1bc34afae tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Created volume successfully.
Sep 24 18:48:46 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Flow 'volume_create_manager' (f0ff46b7-d920-456e-b53b-136208619299) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5621c467-3eeb-4c78-a369-f613a3b82566) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (5621c467-3eeb-4c78-a369-f613a3b82566) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660845233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05dc0d9-5834-48e1-91b7-f562bdfed310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b172a306111b477696da1fb1cf56da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:46Z,use_quota=True,user_id='cf2a7ac9ca3b402b804f1f0a28cf1d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b610cef-dbeb-4744-b7a4-9e24e36551ba) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (7b610cef-dbeb-4744-b7a4-9e24e36551ba) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1591187-9fb8-46ba-9634-120f0df98b1b) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (f1591187-9fb8-46ba-9634-120f0df98b1b) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b05dc0d9-5834-48e1-91b7-f562bdfed310', 'volume_name': 'volume-b05dc0d9-5834-48e1-91b7-f562bdfed310', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc27c6d-47a6-45e7-87e3-8cfd6a895d20) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (ffc27c6d-47a6-45e7-87e3-8cfd6a895d20) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d23bb49-f3fe-4b57-94dc-594e9fee41fb) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:46 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume b05dc0d9-5834-48e1-91b7-f562bdfed310: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b05dc0d9-5834-48e1-91b7-f562bdfed310', 'volume_size': 1}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1660845233',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b05dc0d9-5834-48e1-91b7-f562bdfed310,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b172a306111b477696da1fb1cf56da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:46Z,use_quota=True,user_id='cf2a7ac9ca3b402b804f1f0a28cf1d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Creating volume b05dc0d9-5834-48e1-91b7-f562bdfed310 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:46 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b05dc0d9-5834-48e1-91b7-f562bdfed310 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:46 devstack quobyte-client[84204]: System call of process 100529 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:46 devstack quobyte-client[84204]: System call of process 100529 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:46 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=165, name=volume-b05dc0d9-5834-48e1-91b7-f562bdfed310, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b05dc0d9-5834-48e1-91b7-f562bdfed310 1073741824" returned: 0 in 0.643s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:46 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b05dc0d9-5834-48e1-91b7-f562bdfed310 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:47 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Flow 'volume_create_manager' (5e9837e5-3b9e-4dd3-88bc-e4a1b070f1e8) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78bda5b7-ac63-4ed1-a64c-8bc844c3c12a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b05dc0d9-5834-48e1-91b7-f562bdfed310" returned: 0 in 0.713s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] <== create_volume: return (1408ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.427s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (78bda5b7-ac63-4ed1-a64c-8bc844c3c12a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-390281693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca9db57f-57b5-42b3-8629-dbd3e5833149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b172a306111b477696da1fb1cf56da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:46Z,use_quota=True,user_id='cf2a7ac9ca3b402b804f1f0a28cf1d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2380a9df-60a6-4953-8750-a8ff781d44da) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (2380a9df-60a6-4953-8750-a8ff781d44da) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db58425-ae78-45a5-93fc-ec2ce65f494a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (1db58425-ae78-45a5-93fc-ec2ce65f494a) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'ca9db57f-57b5-42b3-8629-dbd3e5833149', 'volume_name': 'volume-ca9db57f-57b5-42b3-8629-dbd3e5833149', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a3790e-6f96-40f9-b6ba-081f558695f3) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (04a3790e-6f96-40f9-b6ba-081f558695f3) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fc24a6-a44c-49da-a6fd-f57553b53b51) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:47 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume ca9db57f-57b5-42b3-8629-dbd3e5833149: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-ca9db57f-57b5-42b3-8629-dbd3e5833149', 'volume_size': 1}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:46Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-390281693',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=ca9db57f-57b5-42b3-8629-dbd3e5833149,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b172a306111b477696da1fb1cf56da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:46Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:46Z,use_quota=True,user_id='cf2a7ac9ca3b402b804f1f0a28cf1d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Creating volume ca9db57f-57b5-42b3-8629-dbd3e5833149 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:47 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:48:47 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ca9db57f-57b5-42b3-8629-dbd3e5833149 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:47 devstack quobyte-client[84204]: System call of process 100534 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:47 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=166, name=volume-ca9db57f-57b5-42b3-8629-dbd3e5833149, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (0d23bb49-f3fe-4b57-94dc-594e9fee41fb) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b05dc0d9-5834-48e1-91b7-f562bdfed310', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2a7325-904a-41c3-ba8d-e96900fb203c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:48 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Flow 'volume_create_manager' (bbd459a6-2f93-4760-ba28-1ca57b0db3e6) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959db2ae-414a-4176-a6b4-9029fd1d44fc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:48 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Flow 'volume_create_manager' (53e6014d-8405-4d16-970b-8a7ebe3a7060) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd8e244-54c2-444c-8459-5b808545e820) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:48 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume volume-b05dc0d9-5834-48e1-91b7-f562bdfed310 (b05dc0d9-5834-48e1-91b7-f562bdfed310): created successfully
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (2a2a7325-904a-41c3-ba8d-e96900fb203c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Flow 'volume_create_manager' (f0ff46b7-d920-456e-b53b-136208619299) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:48 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-e12383b7-82b2-4ce7-b417-6d9ccafd9f78 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Created volume successfully.
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ca9db57f-57b5-42b3-8629-dbd3e5833149 1073741824" returned: 0 in 1.011s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (959db2ae-414a-4176-a6b4-9029fd1d44fc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1904980477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b46953-fe24-4087-9417-7237e92a5ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b172a306111b477696da1fb1cf56da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:47Z,use_quota=True,user_id='cf2a7ac9ca3b402b804f1f0a28cf1d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c2fa09-54a0-4f43-81c9-d234d7762f9c) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (c9c2fa09-54a0-4f43-81c9-d234d7762f9c) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8206ae-932b-45b5-af59-6f77a3de2627) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (ad8206ae-932b-45b5-af59-6f77a3de2627) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'f9b46953-fe24-4087-9417-7237e92a5ae9', 'volume_name': 'volume-f9b46953-fe24-4087-9417-7237e92a5ae9', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c290c400-1c07-4a7c-b9e9-21e877bc42bc) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c290c400-1c07-4a7c-b9e9-21e877bc42bc) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51e4406-df98-4592-9793-e447137b0592) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:48 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume f9b46953-fe24-4087-9417-7237e92a5ae9: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-f9b46953-fe24-4087-9417-7237e92a5ae9', 'volume_size': 1}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:48 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ca9db57f-57b5-42b3-8629-dbd3e5833149 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (8cd8e244-54c2-444c-8459-5b808545e820) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-700871381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919f0d77-3a89-42ca-9f5a-1a3d94a24574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b172a306111b477696da1fb1cf56da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:48Z,use_quota=True,user_id='cf2a7ac9ca3b402b804f1f0a28cf1d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c51e2d-7bb0-496f-8835-c98cb68d9ec5) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (f2c51e2d-7bb0-496f-8835-c98cb68d9ec5) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063e43c5-e59e-4f41-9a27-2d1eefc0b864) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (063e43c5-e59e-4f41-9a27-2d1eefc0b864) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '919f0d77-3a89-42ca-9f5a-1a3d94a24574', 'volume_name': 'volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e1e802-358a-42af-9f06-6a2e7b33a05f) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (f8e1e802-358a-42af-9f06-6a2e7b33a05f) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37425607-f855-43e3-b625-e482f83cfa81) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:49 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume 919f0d77-3a89-42ca-9f5a-1a3d94a24574: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574', 'volume_size': 1}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:49 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Flow 'volume_create_manager' (67ed0403-700b-4b9d-b095-f5ccd878fd26) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58618aa1-d518-4e25-b49d-f57967cb9371) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ca9db57f-57b5-42b3-8629-dbd3e5833149" returned: 0 in 0.696s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] <== create_volume: return (1789ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 1.795s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.730s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1904980477',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=f9b46953-fe24-4087-9417-7237e92a5ae9,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b172a306111b477696da1fb1cf56da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:47Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:47Z,use_quota=True,user_id='cf2a7ac9ca3b402b804f1f0a28cf1d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Creating volume f9b46953-fe24-4087-9417-7237e92a5ae9 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:49 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f9b46953-fe24-4087-9417-7237e92a5ae9 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:49 devstack quobyte-client[84204]: System call of process 100538 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:49 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=167, name=volume-f9b46953-fe24-4087-9417-7237e92a5ae9, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (58618aa1-d518-4e25-b49d-f57967cb9371) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1330481941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fbc25a-053c-4017-910e-7b8a62f156c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b172a306111b477696da1fb1cf56da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:48Z,use_quota=True,user_id='cf2a7ac9ca3b402b804f1f0a28cf1d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e4e38d-de60-4be1-98bc-18b37ffb2f9a) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b8e4e38d-de60-4be1-98bc-18b37ffb2f9a) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:49 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c437705d-891f-4cd9-8e2e-39d705679770) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c437705d-891f-4cd9-8e2e-39d705679770) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'b3fbc25a-053c-4017-910e-7b8a62f156c8', 'volume_name': 'volume-b3fbc25a-053c-4017-910e-7b8a62f156c8', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f61216-6691-429c-8f0a-c46ff22ed879) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (b1f61216-6691-429c-8f0a-c46ff22ed879) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2527f2c-1fcc-47f6-93ab-f265b312b618) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:50 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume b3fbc25a-053c-4017-910e-7b8a62f156c8: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-b3fbc25a-053c-4017-910e-7b8a62f156c8', 'volume_size': 1}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b5fc24a6-a44c-49da-a6fd-f57553b53b51) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-ca9db57f-57b5-42b3-8629-dbd3e5833149', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9618d2b-7ae2-4ae8-a108-c3e50e4021f9) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f9b46953-fe24-4087-9417-7237e92a5ae9 1073741824" returned: 0 in 0.559s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f9b46953-fe24-4087-9417-7237e92a5ae9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f9b46953-fe24-4087-9417-7237e92a5ae9" returned: 0 in 0.157s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] <== create_volume: return (801ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.817s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:50 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume volume-ca9db57f-57b5-42b3-8629-dbd3e5833149 (ca9db57f-57b5-42b3-8629-dbd3e5833149): created successfully
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (e9618d2b-7ae2-4ae8-a108-c3e50e4021f9) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Flow 'volume_create_manager' (5e9837e5-3b9e-4dd3-88bc-e4a1b070f1e8) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.460s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:47Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-700871381',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=919f0d77-3a89-42ca-9f5a-1a3d94a24574,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b172a306111b477696da1fb1cf56da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:48Z,use_quota=True,user_id='cf2a7ac9ca3b402b804f1f0a28cf1d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Creating volume 919f0d77-3a89-42ca-9f5a-1a3d94a24574 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:50 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:48:50 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:50 devstack quobyte-client[84204]: System call of process 100544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:50 devstack quobyte-client[84204]: System call of process 100544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:50 devstack quobyte-client[84204]: System call of process 100544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:50 devstack quobyte-client[84204]: System call of process 100544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:50 devstack quobyte-client[84204]: System call of process 100544 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:50 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=168, name=volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:50 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a36fb078-d121-46f1-84c5-f2ef6d0edb50 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Created volume successfully.
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (b51e4406-df98-4592-9793-e447137b0592) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-f9b46953-fe24-4087-9417-7237e92a5ae9', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8835c541-5af8-406e-a397-333810b40100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:51 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume volume-f9b46953-fe24-4087-9417-7237e92a5ae9 (f9b46953-fe24-4087-9417-7237e92a5ae9): created successfully
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (8835c541-5af8-406e-a397-333810b40100) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Flow 'volume_create_manager' (bbd459a6-2f93-4760-ba28-1ca57b0db3e6) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574 1073741824" returned: 0 in 0.473s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:51 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-14993b16-d797-4da1-bf44-09a22236ca51 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Created volume successfully.
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574" returned: 0 in 0.238s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] <== create_volume: return (746ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.764s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 1.376s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:48:48Z,deleted=False,deleted_at=None,display_description=None,display_name='tempest-CreateVolumesFromSourceVolumeTest-Volume-1330481941',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=b3fbc25a-053c-4017-910e-7b8a62f156c8,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='b172a306111b477696da1fb1cf56da4f',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:48:48Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:48:48Z,use_quota=True,user_id='cf2a7ac9ca3b402b804f1f0a28cf1d57',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Creating volume b3fbc25a-053c-4017-910e-7b8a62f156c8 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:48:51 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3fbc25a-053c-4017-910e-7b8a62f156c8 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:51 devstack quobyte-client[84204]: System call of process 100549 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:51 devstack quobyte-client[84204]: System call of process 100549 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:48:51 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=169, name=volume-b3fbc25a-053c-4017-910e-7b8a62f156c8, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (37425607-f855-43e3-b625-e482f83cfa81) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47199cf-a493-449d-9d18-c297a77a5b66) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:51 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574 (919f0d77-3a89-42ca-9f5a-1a3d94a24574): created successfully
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (c47199cf-a493-449d-9d18-c297a77a5b66) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Flow 'volume_create_manager' (53e6014d-8405-4d16-970b-8a7ebe3a7060) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3fbc25a-053c-4017-910e-7b8a62f156c8 1073741824" returned: 0 in 0.456s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:51 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3fbc25a-053c-4017-910e-7b8a62f156c8 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:52 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-236be96d-1df8-4f4f-9d7c-f2c08fec0495 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Created volume successfully.
Sep 24 18:48:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3fbc25a-053c-4017-910e-7b8a62f156c8" returned: 0 in 0.252s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:52 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] <== create_volume: return (738ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:48:52 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.760s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (f2527f2c-1fcc-47f6-93ab-f265b312b618) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-b3fbc25a-053c-4017-910e-7b8a62f156c8', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1a1bac-1c8c-413d-ab21-fc74200a8777) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:48:52 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume volume-b3fbc25a-053c-4017-910e-7b8a62f156c8 (b3fbc25a-053c-4017-910e-7b8a62f156c8): created successfully
Sep 24 18:48:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (ab1a1bac-1c8c-413d-ab21-fc74200a8777) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:48:52 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Flow 'volume_create_manager' (67ed0403-700b-4b9d-b095-f5ccd878fd26) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:48:52 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-f3260dca-877c-419f-b84e-db8dfa70c0f7 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Created volume successfully.
Sep 24 18:48:52 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "cinder-b3fbc25a-053c-4017-910e-7b8a62f156c8-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-b3fbc25a-053c-4017-910e-7b8a62f156c8-delete_volume" acquired by "delete_volume" :: waited 0.054s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:53 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "cinder-quobyte-b3fbc25a-053c-4017-910e-7b8a62f156c8" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-quobyte-b3fbc25a-053c-4017-910e-7b8a62f156c8" acquired by "delete_volume" :: waited 0.010s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:53 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d927dae4-f6c9-4c54-9ca8-83dac5c9a66e]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3fbc25a-053c-4017-910e-7b8a62f156c8 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3fbc25a-053c-4017-910e-7b8a62f156c8" returned: 0 in 0.413s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3fbc25a-053c-4017-910e-7b8a62f156c8 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:53 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b3fbc25a-053c-4017-910e-7b8a62f156c8" returned: 0 in 0.107s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:53 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-quobyte-b3fbc25a-053c-4017-910e-7b8a62f156c8" released by "delete_volume" :: held 0.669s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:54 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Created reservations ['2144e3d9-d534-45bd-abdd-1492eccaf315', '655b2332-2c7c-4336-9cc0-4556e4aaac81', '3c8b2451-98de-4900-bf78-d524446c9901', '660d4be5-d883-4dc9-abff-11d6e04e0471'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:54 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:54 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.104s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:54 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:54 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Deleted volume successfully.
Sep 24 18:48:54 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-45912bc2-ff27-442c-9a74-0671fb08ff8b tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-b3fbc25a-053c-4017-910e-7b8a62f156c8-delete_volume" released by "delete_volume" :: held 1.505s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "cinder-919f0d77-3a89-42ca-9f5a-1a3d94a24574-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-919f0d77-3a89-42ca-9f5a-1a3d94a24574-delete_volume" acquired by "delete_volume" :: waited 0.080s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:55 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "cinder-quobyte-919f0d77-3a89-42ca-9f5a-1a3d94a24574" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:55 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-quobyte-919f0d77-3a89-42ca-9f5a-1a3d94a24574" acquired by "delete_volume" :: waited 0.015s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:55 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[22e3fd19-3cba-4d6f-9bae-e795c12a35fb]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574" returned: 0 in 0.387s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:55 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-919f0d77-3a89-42ca-9f5a-1a3d94a24574" returned: 0 in 0.118s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-quobyte-919f0d77-3a89-42ca-9f5a-1a3d94a24574" released by "delete_volume" :: held 0.662s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:56 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Created reservations ['f6d56c37-40d6-4d25-b7ba-449b1b61f429', 'fb90883d-6e78-4365-895a-a0cb54e40600', '703fa540-049a-4417-af78-7927b62eaaad', '8703d26a-e289-46c3-baa7-8cf4874b973e'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:56 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:56 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.104s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:56 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:56 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Deleted volume successfully.
Sep 24 18:48:56 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-229dae53-57aa-42dc-ab5b-d037ce78ca53 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-919f0d77-3a89-42ca-9f5a-1a3d94a24574-delete_volume" released by "delete_volume" :: held 1.568s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "cinder-f9b46953-fe24-4087-9417-7237e92a5ae9-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-f9b46953-fe24-4087-9417-7237e92a5ae9-delete_volume" acquired by "delete_volume" :: waited 0.022s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:57 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "cinder-quobyte-f9b46953-fe24-4087-9417-7237e92a5ae9" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:57 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-quobyte-f9b46953-fe24-4087-9417-7237e92a5ae9" acquired by "delete_volume" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:57 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[08d48e9b-46b3-475d-aa25-b586dfe8c03e]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:57 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f9b46953-fe24-4087-9417-7237e92a5ae9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f9b46953-fe24-4087-9417-7237e92a5ae9" returned: 0 in 0.387s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f9b46953-fe24-4087-9417-7237e92a5ae9 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-f9b46953-fe24-4087-9417-7237e92a5ae9" returned: 0 in 0.130s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-quobyte-f9b46953-fe24-4087-9417-7237e92a5ae9" released by "delete_volume" :: held 0.661s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Created reservations ['769e697f-eabe-4313-acdd-34a0ff082da1', 'e96e2cba-099d-41ca-a603-4fca76455e2d', '442b62c4-58eb-4322-8b3c-a2bd173ae6ea', '74343ad7-95aa-4a98-9c12-08a8ce4f8a8f'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.011s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.109s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:48:58 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:48:58 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Deleted volume successfully.
Sep 24 18:48:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-25435a12-e461-4049-bb82-b88869762dc0 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-f9b46953-fe24-4087-9417-7237e92a5ae9-delete_volume" released by "delete_volume" :: held 1.545s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:48:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "cinder-ca9db57f-57b5-42b3-8629-dbd3e5833149-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-ca9db57f-57b5-42b3-8629-dbd3e5833149-delete_volume" acquired by "delete_volume" :: waited 0.040s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:59 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:48:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "cinder-quobyte-ca9db57f-57b5-42b3-8629-dbd3e5833149" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:48:59 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-quobyte-ca9db57f-57b5-42b3-8629-dbd3e5833149" acquired by "delete_volume" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:48:59 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[544f01a5-46d1-418f-b3a8-f24c36778b52]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:48:59 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ca9db57f-57b5-42b3-8629-dbd3e5833149 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ca9db57f-57b5-42b3-8629-dbd3e5833149" returned: 0 in 0.394s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ca9db57f-57b5-42b3-8629-dbd3e5833149 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-ca9db57f-57b5-42b3-8629-dbd3e5833149" returned: 0 in 0.097s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:00 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-quobyte-ca9db57f-57b5-42b3-8629-dbd3e5833149" released by "delete_volume" :: held 0.665s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:00 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Created reservations ['2b3cc619-c5ff-4e74-bf2a-777068e19974', '48d70ebf-12e6-4668-ad9a-02a6d1e2cca9', '3914b965-299b-4c8e-8f51-4b5c50bd7174', 'c71009c6-283c-4d89-84de-99380aabffc1'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:49:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:49:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:49:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:49:00 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:49:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.013s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:49:00 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:01 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.087s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:01 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:49:01 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Deleted volume successfully.
Sep 24 18:49:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-bfba1fa6-2bd3-44fb-a758-1a14c01c3cf6 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-ca9db57f-57b5-42b3-8629-dbd3e5833149-delete_volume" released by "delete_volume" :: held 1.576s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:01 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "cinder-b05dc0d9-5834-48e1-91b7-f562bdfed310-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:49:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-b05dc0d9-5834-48e1-91b7-f562bdfed310-delete_volume" acquired by "delete_volume" :: waited 0.038s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:49:02 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:49:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "cinder-quobyte-b05dc0d9-5834-48e1-91b7-f562bdfed310" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:49:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-quobyte-b05dc0d9-5834-48e1-91b7-f562bdfed310" acquired by "delete_volume" :: waited 0.011s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:49:02 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[57427418-bfe0-4ec3-a42c-4b53f71cf091]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:49:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b05dc0d9-5834-48e1-91b7-f562bdfed310 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b05dc0d9-5834-48e1-91b7-f562bdfed310" returned: 0 in 0.420s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b05dc0d9-5834-48e1-91b7-f562bdfed310 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:02 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-b05dc0d9-5834-48e1-91b7-f562bdfed310" returned: 0 in 0.111s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:02 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-quobyte-b05dc0d9-5834-48e1-91b7-f562bdfed310" released by "delete_volume" :: held 0.687s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:03 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Created reservations ['41ae4b01-79ef-47d9-bf59-b825d5dda4be', 'ad7b2839-3985-4f04-bc1b-21318e7c6cab', '9edfac5e-8886-4928-b3f8-ddc0ff1b0fb4', '678916b9-b8a0-4e9a-9746-2d2c883f7ffa'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:49:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:49:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.006s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:49:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:49:03 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:49:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.018s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:49:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:03 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.133s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:03 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:49:03 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Deleted volume successfully.
Sep 24 18:49:03 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-091c1841-c5b8-4c64-a7e5-f67bf7b4cdd9 tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-b05dc0d9-5834-48e1-91b7-f562bdfed310-delete_volume" released by "delete_volume" :: held 1.835s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "cinder-5c5f8daf-1881-450e-b9d0-45586fb340e4-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:49:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-5c5f8daf-1881-450e-b9d0-45586fb340e4-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:49:04 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:49:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "cinder-quobyte-5c5f8daf-1881-450e-b9d0-45586fb340e4" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:49:04 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-quobyte-5c5f8daf-1881-450e-b9d0-45586fb340e4" acquired by "delete_volume" :: waited 0.012s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:49:04 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[a549425a-f67e-4889-b312-652c8a1f61af]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:49:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5c5f8daf-1881-450e-b9d0-45586fb340e4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5c5f8daf-1881-450e-b9d0-45586fb340e4" returned: 0 in 0.400s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:04 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5c5f8daf-1881-450e-b9d0-45586fb340e4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-5c5f8daf-1881-450e-b9d0-45586fb340e4" returned: 0 in 0.148s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-quobyte-5c5f8daf-1881-450e-b9d0-45586fb340e4" released by "delete_volume" :: held 0.722s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:05 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Created reservations ['c75ef087-5a3c-4ce2-98a5-dcb9eedd37a0', '27972582-4121-45c2-85a9-021a46278364', '59c5506e-fe10-4858-a50f-a89c1e925551', '9228b5ce-c7fa-4664-a90d-7daca442cac8'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:49:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:49:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.004s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:49:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:49:05 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:49:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.012s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:49:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:05 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.113s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:05 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:49:05 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Deleted volume successfully.
Sep 24 18:49:05 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-ee3746f9-a748-4de7-8caa-fdeca92b8a8f tempest-CreateVolumesFromSourceVolumeTest-512268704 None] Lock "cinder-5c5f8daf-1881-450e-b9d0-45586fb340e4-delete_volume" released by "delete_volume" :: held 1.634s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:09 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Flow 'volume_create_manager' (d7abdf28-aa16-43c0-baf0-1ac165e6cc1d) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b681676b-bc95-4b75-a480-2e014c653199) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b681676b-bc95-4b75-a480-2e014c653199) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47669397-bc4b-4bd2-939a-1b9d6727dc8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aceb5172a5240b7a6ff6a967a4e172e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:49:09Z,use_quota=True,user_id='0519966d84f044c98a393dac4c80989c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148030a0-74a1-42b8-9a6b-253ad50bda18) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (148030a0-74a1-42b8-9a6b-253ad50bda18) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b39330-1704-4b07-8273-eb81a7f6f7ae) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (c1b39330-1704-4b07-8273-eb81a7f6f7ae) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': '47669397-bc4b-4bd2-939a-1b9d6727dc8e', 'volume_name': 'volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246c04c7-f32c-4743-8d76-07e8c16606fe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (246c04c7-f32c-4743-8d76-07e8c16606fe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b62e8b3-e520-495f-94d6-9b86def8a745) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:49:09 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Volume 47669397-bc4b-4bd2-939a-1b9d6727dc8e: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e', 'volume_size': 1}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:49:09Z,deleted=False,deleted_at=None,display_description=None,display_name='CinderUnicodeTest塵㼗‽',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=47669397-bc4b-4bd2-939a-1b9d6727dc8e,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aceb5172a5240b7a6ff6a967a4e172e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:49:09Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:49:09Z,use_quota=True,user_id='0519966d84f044c98a393dac4c80989c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Creating volume 47669397-bc4b-4bd2-939a-1b9d6727dc8e {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.001s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.009s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:49:09 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:09 devstack quobyte-client[84204]: System call of process 100592 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:49:09 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=170, name=volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e 1073741824" returned: 0 in 0.330s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e" returned: 0 in 0.086s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] <== create_volume: return (484ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:49:09 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.498s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:49:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (2b62e8b3-e520-495f-94d6-9b86def8a745) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:49:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6094c160-bc6d-4f50-95d3-dda88b799bfe) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:49:10 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Volume volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e (47669397-bc4b-4bd2-939a-1b9d6727dc8e): created successfully
Sep 24 18:49:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (6094c160-bc6d-4f50-95d3-dda88b799bfe) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:49:10 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Flow 'volume_create_manager' (d7abdf28-aa16-43c0-baf0-1ac165e6cc1d) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:49:10 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-6ca99ee1-c651-4e8f-9480-1c17755ecc73 tempest-CinderUnicodeTest-1734366713 None] Created volume successfully.
Sep 24 18:49:11 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.flows.manager.create_volume [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Volume reschedule parameters: True retry: {'num_attempts': 1, 'backends': ['devstack@QuobyteHD#QuobyteHD'], 'hosts': ['devstack@QuobyteHD#QuobyteHD']} {{(pid=84177) get_flow /opt/stack/cinder/cinder/volume/flows/manager/create_volume.py:1387}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Flow 'volume_create_manager' (02dffa60-1c85-475a-b905-1ea662430c59) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d55f89-1986-4da0-bf17-e7498c4cab21) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeRefTask;volume:create' (b3d55f89-1986-4da0-bf17-e7498c4cab21) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:49:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1442807725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aceb5172a5240b7a6ff6a967a4e172e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:49:12Z,use_quota=True,user_id='0519966d84f044c98a393dac4c80989c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e46922-4072-4e4b-aacc-89af369af4a2) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.OnFailureRescheduleTask;volume:create' (b0e46922-4072-4e4b-aacc-89af369af4a2) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3445ebad-3738-44fe-960a-0dcdebc68100) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.ExtractVolumeSpecTask;volume:create' (3445ebad-3738-44fe-960a-0dcdebc68100) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'type': 'raw', 'volume_id': 'a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1', 'volume_name': 'volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30d3d62-f39d-44d6-a03f-0dca6e2657b1) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.NotifyVolumeActionTask;volume:create, create.start' (c30d3d62-f39d-44d6-a03f-0dca6e2657b1) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46129966-7cf0-47e5-816f-d313fedc9034) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:49:11 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Volume a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1: being created as raw with specification: {'status': 'creating', 'volume_name': 'volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1', 'volume_size': 1}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] ==> create_volume: call "{'self': <cinder.volume.drivers.quobyte.QuobyteDriver object at 0x7f30353bfaf0>, 'volume': Volume(_name_id=None,admin_metadata=<?>,attach_status='detached',availability_zone='nova',bootable=False,cluster=<?>,cluster_name=None,consistencygroup=<?>,consistencygroup_id=None,created_at=2025-09-24T16:49:11Z,deleted=False,deleted_at=None,display_description='קייפש',display_name='tempest-CinderUnicodeTest-Volume-1442807725',ec2_id=None,encryption_key_id=None,glance_metadata=<?>,group=<?>,group_id=None,host='devstack@QuobyteHD#QuobyteHD',id=a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1,launched_at=None,metadata={},migration_status=None,multiattach=False,previous_status=None,project_id='1aceb5172a5240b7a6ff6a967a4e172e',provider_auth=None,provider_geometry=None,provider_id=None,provider_location=None,replication_driver_data=None,replication_extended_status=None,replication_status=None,scheduled_at=2025-09-24T16:49:12Z,service_uuid=None,shared_targets=True,size=1,snapshot_id=None,snapshots=<?>,source_volid=None,status='creating',terminated_at=None,updated_at=2025-09-24T16:49:12Z,use_quota=True,user_id='0519966d84f044c98a393dac4c80989c',volume_attachment=VolumeAttachmentList,volume_type=VolumeType(3021e398-7537-45bb-b7e3-44b4c29efb6f),volume_type_id=3021e398-7537-45bb-b7e3-44b4c29efb6f)}" {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1493}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Creating volume a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 {{(pid=84177) create_volume /opt/stack/cinder/cinder/volume/drivers/remotefs.py:290}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.000s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.010s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Selected 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b as target Quobyte volume. {{(pid=84177) _find_share /opt/stack/cinder/cinder/volume/drivers/quobyte.py:655}}
Sep 24 18:49:11 devstack cinder-volume[84177]: INFO cinder.volume.drivers.remotefs [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] casted to 10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b
Sep 24 18:49:11 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 1073741824 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:11 devstack quobyte-client[84204]: System call of process 100597 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:49:11 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=171, name=volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:49:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] CMD "qemu-img create -f qcow2 -o preallocation=metadata /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 1073741824" returned: 0 in 0.314s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] CMD "chmod ugo+rw /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1" returned: 0 in 0.083s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:12 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] <== create_volume: return (465ms) {'provider_location': '10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'} {{(pid=84177) trace_logging_wrapper /opt/stack/cinder/cinder/volume/volume_utils.py:1518}}
Sep 24 18:49:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_volume" :: held 0.477s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:49:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeFromSpecTask;volume:create' (46129966-7cf0-47e5-816f-d313fedc9034) transitioned into state 'SUCCESS' from state 'RUNNING' with result '{'status': 'creating', 'volume_name': 'volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1', 'volume_size': 1}' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:49:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d54a127-16cc-4b31-9369-2d8d580cf9d4) transitioned into state 'RUNNING' from state 'PENDING' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:194}}
Sep 24 18:49:12 devstack cinder-volume[84177]: INFO cinder.volume.flows.manager.create_volume [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Volume volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 (a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1): created successfully
Sep 24 18:49:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Task 'cinder.volume.flows.manager.create_volume.CreateVolumeOnFinishTask;volume:create, create.end' (4d54a127-16cc-4b31-9369-2d8d580cf9d4) transitioned into state 'SUCCESS' from state 'RUNNING' with result 'None' {{(pid=84177) _task_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:182}}
Sep 24 18:49:12 devstack cinder-volume[84177]: DEBUG cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Flow 'volume_create_manager' (02dffa60-1c85-475a-b905-1ea662430c59) transitioned into state 'SUCCESS' from state 'RUNNING' {{(pid=84177) _flow_receiver /opt/stack/data/venv/lib/python3.10/site-packages/taskflow/listeners/logging.py:145}}
Sep 24 18:49:12 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-33bc2052-ca18-4664-90e5-ad0b328b9cd3 tempest-CinderUnicodeTest-1734366713 None] Created volume successfully.
Sep 24 18:49:12 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:49:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "quobyte" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:49:12 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: waited 0.002s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:49:13 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Creating offline snapshot d1a22867-f171-4560-a3f7-a08259b8a2c4 of volume a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 {{(pid=84177) _create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1694}}
Sep 24 18:49:13 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[3f08ac92-5f24-4291-85e0-f5e54753b406]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:49:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:13 devstack quobyte-client[84204]: System call of process 100609 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:49:13 devstack quobyte-client[84204]: System call of process 100609 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:49:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1" returned: 0 in 0.606s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:13 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4 1G {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:13 devstack quobyte-client[84204]: System call of process 100634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:49:13 devstack quobyte-client[84204]: System call of process 100634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:49:13 devstack quobyte-client[84204]: System call of process 100634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:49:13 devstack quobyte-client[84204]: System call of process 100634 ( qemu-img ) is being interrupted by a signal. Cancelling any RPC and returning EINTR to the application.
Sep 24 18:49:13 devstack quobyte-client[84204]: The server volume:1e92ecc5-d598-471f-9681-55a005bf7469@10.10.41.181:7862(P) returned an error. Error Value: POSIX_ERROR_EACCES Error message: access denied, volumeId=1e92ecc5-d598-471f-9681-55a005bf7469, inode=172, name=volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4, owner/owning group/mode=hidden, acl=hidden, requestor=user=quobyte(groups=quobyte,quobyte,sudo,users,libvirt,tenants=c5c34c62-e928-4c2c-b45d-9dec72b25a83,privileged=false,source=TRUSTED_SERVICE,client-address=/192.168.122.25), requestorAccessMask=0
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] CMD "qemu-img create -f qcow2 -o backing_file=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1,backing_fmt=qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4 1G" returned: 0 in 0.301s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): qemu-img rebase -u -b volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] CMD "qemu-img rebase -u -b volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 -F qcow2 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4" returned: 0 in 0.152s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4 is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4" returned: 0 in 0.083s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Setting permissions: /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 -> 1000:1000 {{(pid=84177) _do_create_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1584}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] CMD "chown --reference=/opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4" returned: 0 in 0.095s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] CMD "truncate -s0 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.info" returned: 0 in 0.093s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] File path /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.info is being set with permissions: 660 {{(pid=84177) _set_rw_permissions /opt/stack/cinder/cinder/volume/drivers/remotefs.py:492}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.info {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] CMD "chmod 660 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.info" returned: 0 in 0.086s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:14 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver.create_snapshot" :: held 1.774s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:49:15 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-96260407-1556-4edb-9753-cd8f1ea47c25 tempest-CinderUnicodeTest-1734366713 None] Create snapshot completed successfully
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "cinder-d1a22867-f171-4560-a3f7-a08259b8a2c4-delete_snapshot" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-d1a22867-f171-4560-a3f7-a08259b8a2c4-delete_snapshot" acquired by "delete_snapshot" :: waited 0.057s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:49:16 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "cinder-quobyte-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1" by "delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-quobyte-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1" acquired by "delete_snapshot" :: waited 0.010s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "cinder-quobyte-d1a22867-f171-4560-a3f7-a08259b8a2c4" by "_delete_snapshot" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-quobyte-d1a22867-f171-4560-a3f7-a08259b8a2c4" acquired by "_delete_snapshot" :: waited 0.020s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Deleting offline snapshot d1a22867-f171-4560-a3f7-a08259b8a2c4 of volume a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1278}}
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] snapshot_file for this snap is: volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4 {{(pid=84177) _delete_snapshot /opt/stack/cinder/cinder/volume/drivers/remotefs.py:1307}}
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[ba455e05-ddf7-4684-9113-24278a4a3aeb]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4" returned: 0 in 0.366s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.remotefs [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Fetching qemu-img info with special backing_file_template: (/opt/stack/data/cinder/mnt/[0-9a-f]+/)?(volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1(.(tmp-snap-)?[0-9a-f-]+)?|volume_from_snapshot_cache/(tmp-snap-)?[0-9a-f-]+(.(child-|parent-)[0-9a-f-]+)?)$ {{(pid=84177) _qemu_img_info_base /opt/stack/cinder/cinder/volume/drivers/remotefs.py:886}}
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[cbfbbbe4-0295-483c-8cb6-6c3e5bda2743]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:49:16 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1" returned: 0 in 0.381s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] CMD "qemu-img commit -d /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4" returned: 0 in 0.231s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:17 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1.d1a22867-f171-4560-a3f7-a08259b8a2c4" returned: 0 in 0.086s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:17 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-quobyte-d1a22867-f171-4560-a3f7-a08259b8a2c4" released by "_delete_snapshot" :: held 1.376s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:17 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-quobyte-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1" released by "delete_snapshot" :: held 1.409s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:17 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Created reservations ['6d58cf41-3050-4eec-a0ec-a58f1042c63e', '9c4fee03-c989-43d2-8ee1-a2d47b356d27', 'e439642f-11bc-407f-95de-ed7ee4a71a2a', '2ab39a79-1e0b-416b-9ec4-3fc167b26acd'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:49:18 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Delete snapshot completed successfully.
Sep 24 18:49:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-af95fdb8-be97-4534-a2d2-c4f224031202 tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-d1a22867-f171-4560-a3f7-a08259b8a2c4-delete_snapshot" released by "delete_snapshot" :: held 1.836s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "cinder-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:49:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1-delete_volume" acquired by "delete_volume" :: waited 0.026s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:49:18 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:49:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "cinder-quobyte-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:49:18 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-quobyte-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1" acquired by "delete_volume" :: waited 0.014s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:49:18 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[d55f357f-5755-4b79-b16b-608d080d0d39]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:49:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1" returned: 0 in 0.387s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:18 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1" returned: 0 in 0.114s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-quobyte-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1" released by "delete_volume" :: held 0.682s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:19 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Created reservations ['4073c51a-20ed-49db-a54e-60e6590c89fe', 'c4fe9da3-3411-4a39-b1ce-3a0e39f07c0f', 'a4fb2236-c479-4b33-86a7-5886d7dcedd2', '4ea4ef51-5de0-40a7-a199-6eec7f750835'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:49:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:49:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:49:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:49:19 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:49:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.014s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:49:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:19 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.110s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:19 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:49:19 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Deleted volume successfully.
Sep 24 18:49:19 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-a69fcaa3-b814-4e4c-b4e5-a42bfbcb85c8 tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-a6c6a9ac-abd8-4b1e-b59b-b1107d5ce6e1-delete_volume" released by "delete_volume" :: held 1.569s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "cinder-47669397-bc4b-4bd2-939a-1b9d6727dc8e-delete_volume" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:49:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-47669397-bc4b-4bd2-939a-1b9d6727dc8e-delete_volume" acquired by "delete_volume" :: waited 0.041s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:49:20 devstack cinder-volume[84177]: WARNING cinder.volume.volume_utils [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Volume driver (QuobyteDriver 1.1.13) is currently unsupported and may be removed in the next release of OpenStack.  Use at your own risk.
Sep 24 18:49:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "cinder-quobyte-47669397-bc4b-4bd2-939a-1b9d6727dc8e" by "delete_volume" {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:143}}
Sep 24 18:49:20 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-quobyte-47669397-bc4b-4bd2-939a-1b9d6727dc8e" acquired by "delete_volume" :: waited 0.013s {{(pid=84177) __acquire /opt/stack/cinder/cinder/coordination.py:146}}
Sep 24 18:49:20 devstack cinder-volume[84177]: DEBUG oslo.privsep.daemon [-] privsep: reply[87be9478-b249-49c5-8903-ab339f767d57]: (4, 'qcow2') {{(pid=84475) _call_back /opt/stack/data/venv/lib/python3.10/site-packages/oslo_privsep/daemon.py:515}}
Sep 24 18:49:20 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): /opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] CMD "/opt/stack/data/venv/bin/python3.10 -m oslo_concurrency.prlimit --as=1073741824 --cpu=60 -- env LC_ALL=C qemu-img info -f qcow2 --output=json --force-share /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e" returned: 0 in 0.405s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] CMD "rm -f /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4/volume-47669397-bc4b-4bd2-939a-1b9d6727dc8e" returned: 0 in 0.116s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-quobyte-47669397-bc4b-4bd2-939a-1b9d6727dc8e" released by "delete_volume" :: held 0.692s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=104,cinder:INSERT=31,cinder:UPDATE=160,cinder:DELETE=13 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:INSERT=41,cinder:SELECT=93,cinder:UPDATE=150,cinder:DELETE=12 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG cinder.quota [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Created reservations ['58acf94e-bc9e-4bce-a0aa-2d1bb45b7f6e', '7854e580-92d2-4347-ad65-3fb7413a3fb1', 'd5df42bd-ea4c-4211-8ab4-44b7d3f6c862', '852c7912-b64a-48d6-8550-35392670b436'] {{(pid=84177) reserve /opt/stack/cinder/cinder/quota.py:752}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Acquiring lock "quobyte_ensure" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:405}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte_ensure" acquired by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: waited 0.003s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:410}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Quobyte Volume URL set to: {'10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b': None} {{(pid=84177) _load_shares_config /opt/stack/cinder/cinder/volume/drivers/quobyte.py:604}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG cinder.volume.drivers.quobyte [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Available shares ['10.10.41.181/cinder-vol-e6094fbf-960d-42ac-bd6c-9b996d45837b'] {{(pid=84177) _ensure_shares_mounted /opt/stack/cinder/cinder/volume/drivers/quobyte.py:634}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.lockutils [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Lock "quobyte_ensure" "released" by "cinder.volume.drivers.quobyte.QuobyteDriver._ensure_shares_mounted" :: held 0.015s {{(pid=84177) inner /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/lockutils.py:424}}
Sep 24 18:49:21 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Running cmd (subprocess): df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4 {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:349}}
Sep 24 18:49:22 devstack cinder-volume[84177]: DEBUG oslo_concurrency.processutils [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] CMD "df --portability --block-size 1 /opt/stack/data/cinder/mnt/4dab985082241854a669f406912ca1f4" returned: 0 in 0.086s {{(pid=84177) execute /opt/stack/data/venv/lib/python3.10/site-packages/oslo_concurrency/processutils.py:372}}
Sep 24 18:49:22 devstack cinder-volume[84177]: DEBUG cinder.manager [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Notifying Schedulers of capabilities ... {{(pid=84177) _publish_service_capabilities /opt/stack/cinder/cinder/manager.py:202}}
Sep 24 18:49:22 devstack cinder-volume[84177]: INFO cinder.volume.manager [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Deleted volume successfully.
Sep 24 18:49:22 devstack cinder-volume[84177]: DEBUG cinder.coordination [None req-5addc996-618b-4e7c-8797-5c9b2df58dac tempest-CinderUnicodeTest-1734366713 None] Lock "cinder-47669397-bc4b-4bd2-939a-1b9d6727dc8e-delete_volume" released by "delete_volume" :: held 1.615s {{(pid=84177) __release /opt/stack/cinder/cinder/coordination.py:157}}
Sep 24 18:49:31 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=6,cinder:SELECT=2 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:49:32 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=4,cinder:INSERT=4,cinder:UPDATE=9,cinder:DELETE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:49:47 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:SELECT=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}
Sep 24 18:49:47 devstack cinder-volume[84177]: DEBUG dbcounter [-] [84177] Writing DB stats cinder:UPDATE=1 {{(pid=84177) stat_writer /opt/stack/data/venv/lib/python3.10/site-packages/dbcounter.py:115}}